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T he Council on Graduate Medical Education 
(COGME) was authorized by Congress in 
1986 to provide an ongoing assessment of 
physician workforce trends, training issues and fi- 
nancing policies, and to recommend appropriate 
Federal and private sector efforts to address identi- 
fied needs. The legislation calls for COGME to ad- 
vise and make recommendations to the Secretary 
of the Department of Health and Human Services 
(DHHS), the Senate Committee on Labor and Hu- 
man Resources, and the House of Representatives 
Committee on Commerce. The Health Professions 
Education Partnerships Act of 1998 reauthorized 
the Council through September 30, 2002. 

The legislation specifies 17 members for the 
Council. Appointed individuals are to include rep- 
resentatives of practicing primary care physicians, 
national and specialty physician organizations, in- 
ternational medical graduates, medical student and 
house staff associations, schools of medicine and 
osteopathy, public and private teaching hospitals, 
health insurers, business, and labor. Federal repre- 
sentation includes the Assistant Secretary for 
Health, DHHS; the Administrator of the Health Care 
Financing Administration, DHHS; and the Chief 
Medical Director of the Veterans Administration. 

Charge to the Council 

The charge to COGME is broader than the name 
would imply. Title VII of the Public Health Service 
Act, as amended, requires COGME to provide ad- 
vice and recommendations to the Secretary and 
Congress on the following issues: 

1. The supply and distribution of physicians in 
the United States. 

2. Current and future shortages or excesses of 
physicians in medical and surgical specialties 
and subspecialties. 

3. Issues relating to international medical school 
graduates. 

4. Appropriate Federal policies with respect to the 
matters specified in items 1-3, including poli- 
cies concerning changes in the financing of 
undergraduate and graduate medical education 
(GME) programs and changes in the types of 
medical education training in GME programs. 

5. Appropriate efforts to be carried out by hospi- 
tals, schools of medicine, schools of osteopa- 



thy, and accrediting bodies with respect to the 
matters specified in items 1-3, including ef- 
forts for changes in undergraduate and GME 
programs. 

6. Deficiencies and needs for improvements in 
data bases concerning the supply and distri- 
bution of, and postgraduate training programs 
for, physicians in the United States and steps 
that should be taken to eliminate those defi- 
ciencies. 

In addition, the Council is to encourage enti- 
ties providing graduate medical education to con- 
duct activities to voluntarily achieve the recommen- 
dations of the Council specified in item 5. 

COGME Reports 

Since its establishment, COGME has submit- 
ted the following reports to the DHHS Secretary 
and Congress: 

• First Report of the Council (1988) 

• Second Report: The Financial Status of Teach- 
ing Hospitals and the Underrepresentation of 
Minorities in Medicine (1990) 

• Scholar in Residence Report: Reform in Medi- 
cal Education and Medical Education in the 
Ambulatory Setting (1991) 

• Third Report: Improving Access to Health 
Care Through Physician Workforce Reform: 
Directions for the 21st Century (1992) 

• Fourth Report: Recommendations to Improve 
Access to Health Care Through Physician 
Workforce Reform (1994) 

• Fifth Report: Women and Medicine (1995) 

• Sixth Report: Managed Health Care: Implica- 
tions for the Physician Workforce and Medi- 
cal Education (1995) 

• Seventh Report: Physician Workforce Fund- 
ing Recommendations for Department of 
Health and Human Services’ Programs (1995) 

• Report to Congress: Process by Which Inter- 
national Graduates Are Licensed to Practice 
in the United States (1995) 

• Eighth Report: Patient Care Physician Supply 
and Requirements: Testing COGME 
Recommendations (1996) 
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• Ninth Report: Graduate Medical Education 
Consortia: Changing the Governance of 
Graduate Medical Education to Achieve Phy- 
sician Workforce Objectives (1997) 

• Tenth Report: Physician Distribution and 
Health Care Challenges in Rural and 
Inner-City Areas (1998) 

• Eleventh Report: International Medical Gradu- 
ates, The Physician Workforce and GME Pay- 
ment Reform (1998) 



• Twelfth Report: Minorities in Medicine (1998) 

COGME Resource Papers 

• Preparing Learners for Practice in a Managed 
Care Environment (1997) 

• International Medical Graduates: Immigra- 
tion Law and Policy and the U.S. Physician 
Workforce (1998) 
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Executive Summary 




PURPOSE 

This report is intended to clarify the need for, 
and to stimulate the further development of, fresh 
approaches to the professional education of physi- 
cians for contemporary and future medical prac- 
tice. It presents an analysis of the issues influenc- 
ing the preparation of physicians and recommends 
changes in teaching programs. Unlike previous 
COGME reports which have focused on primary 
care, the recommendations in this report apply to 
preparation for many medical specialties. In par- 
ticular, the importance of clinical education in the 
community is no longer limited to the primary care 
specialties. In many specialties, the community 
offers unique educational opportunities that are 
complementary to those of the academic health 
center or teaching hospital. The comprehensive 
preparation of all modem physicians requires ex- 
perience in both traditional and community settings. 

This report advocates the development of high- 
quality, community-based clinical teaching oppor- 
tunities and a faculty incorporating community 
clinician teachers. It calls for expansion and enhance- 
ment of educational relationships with the commu- 
nity and a redefinition of the role of conventional 
medical school and residency program faculty. In 
addition, the report emphasizes the role of rigor- 
ous evaluation systems to assure consistent quality 
and guide the steady evolution of educational sys- 
tems. Finally, the report addresses strategies to fund 
and sustain the recommended changes. 

The findings and associated recommendations 
forming the core of the report are listed below: 

I. UNDERSTANDING THE SYSTEM 
IN WHICH HEALTH CARE IS 
DELIVERED 

FINDING 1 (page 8): Physicians increasingly 
deliver health care to defined populations of 
patients in the context of integrated delivery sys- 
tems or health plans. An improved understand- 
ing of the characteristics of the populations 
served and the attributes of the delivery systems 
is fundamental to effective medical practice. 

Recommendations: 

i ! 

! • Medical students and residents should 
learn the basic principles of health care j 




financing, the benefits and limitations of 
typical health plans, and the characteris- 
tics of the systems in which health care 
may be delivered. 

• The curricula of medical schools and resi- 
dency training programs should include 
clinical learning experiences in the set- 
tings of each of the components of an in- 
tegrated health care delivery system 

o Medical schools and residency training 
programs should provide opportunities 
for medical students and residents to learn 
the contribution of other health profes- 
sionals to the care of their patients and 
augment opportunities for learners to par- 
ticipate in a team approach to patient 
care. 

• Educational programs for medical stu- 
dents and residents should address the 
care of the individual patient in the con- 
text of the population or community of 
which the patient is a member. 



D0 O ESTABLISHING PRACTICAL 
AND RELEVANT TEACHING SITES 

FINDING 2 (page 9): There will be an accel- 
eration in the development of new models 
of medical education that reflect more 
closely the practice of medicine within evolv- 
ing health systems. 

Recommendations : j 

' • Clinical education should occur in settings 
that are representative of the environment 
in which graduates will eventually prac- j 
tice. Medical schools and residency train- j 
ing programs should develop or acquire 
j clinical teaching sites that offer the best | 
I learning opportunities and the highest 
standards of clinical practice. Partner- 
ships with integrated delivery systems, j 
health plans and other organizations i 
should be developed as one strategy to ac- 
complish this. | 

• Medical educators should exploit the po- { 
tential of distance learning technology to j 
deliver educational programs in which ! 
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instruction and evaluation are of a con- 
sistent and high standard across multiple 
settings in the community. 

i 



III. DEVELOPING COMMUNITY 
CLINICIAN TEACHERS 

FINDING 3 (page 13): The selection and sup- 
port of clinician teachers in the community 
will become a fundamental priority of medi- 
cal schools and residency training programs . 
The current roles of faculty members based 
at conventional teaching institutions will be 
significantly changed by expanded concepts 
of medical education and more inclusive 
definitions of faculty membership. 



Recommendations: 

• Medical schools and residency training 
programs should recruit and support 
community clinician teachers. Faculty 
members at community teaching sites 
should be selected for the quality of their 
medical practice and the excellence of 
their teaching. They should be paid and 
otherwise rewarded for their educational 
activities. Teaching institutions should 
develop mechanisms to involve commu- 
nity faculty in the design and operation 
of educational programs. 

• Medical school and residency faculty 
should complement their skills as teach- 
ers of students and residents with compe- 
tencies in faculty development and the 
management of educational programs in 
the community. 

• Residency training programs should take 
the lead in the development of rigorous 
practice-based models of graduate medi- 
cal education in which individual or lim- 
ited numbers of residents are assigned to 
physicians in community teaching prac- 
tices. 



IV. REVISING THE CURRICULUM 
CONTENT AND LEARNING 
PROCESS 

FINDING 4 (page 15): The transformation of 
the health care environment created by 
changing demographics , mechanisms of 
health care financing, and a focus on pre- 
vention and wellness, has a profound effect 



on the practice of medicine. Reflecting these 
changes in educational programs that pre- 
pare medical students and residents for their 
future roles requires innovative strategies 
and new resources. 



Recommendations: 

• Medical schools and residency training 
programs should fundamentally revise the 
preparation of their graduates to reflect 
the changing practice environment while 
sustaining the quality of current teaching 
programs. They should emphasize disci- 
plines that are basic to contemporary 
medical practice such as epidemiology 
and population-based care, health care 
policy and systems, disease prevention and 
wellness, and computer information skills. 

• To effectively serve patients in the new 
health care systems, educational programs 
must prepare physicians in ethical deci- 
sion-making and advanced communica- 
tion skills, including patient advocacy, 
conflict resolution, and teamwork. 

• Medical schools and residency training 
programs should accelerate the incorpo- 
ration of advanced educational concepts 
and techniques such as distance learning, 
standardized patients, and psychometrics 
in order to enhance the quality and con- 
sistency of educational programs. 



V. REINFORCING 
COMMUNICATION SKILLS 

FINDING 5 (page 18): An increasingly diverse 
patient population and a changing health 
care environment magnify the need for ef- 
fective communication by physicians. 



Recommendations: 

• Instruction in and assessment of commu- 
nication skills, particularly related to the 
medical history, should be strengthened 
and expanded to ensure an emphasis 
equal to other major courses and topics. 

• The development and augmentation of 
communication skills with patients includ- 
ing those from differing cultural back- 
grounds, and with colleagues, administra- 
tors, and others should be continued 
throughout medical school and residency 
training. 
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• Physicians should be prepared in a broad 
range of communications skills appropri- 
ate for use with individuals and groups 
and utilizing a diversity of media. An em- 
phasis should be provided on continually 
updating skills to adapt to rapidly-evolv- 
ing circumstances and technology 



VI. ASSURING QUALITY AND 
ACCOUNTABILITY IN PHYSICIAN 
EDUCATION 

FINDING 6 (page 20): The assurance of con- 
sistent quality in medical education will be- 
come increasingly critical as clinical teach- 
ing outside the traditional hospital setting 
expands and as teaching strategies become 
more diverse. Methods designed to assess 
performance evaluation at multiple sites and 
assure the longitudinal development of 
knowledge , skills , and attitudes are becom- 
ing increasingly important. 



Recommendations: 

• Medical educators should continuously 
assess both short-term and longitudinal 
outcomes in the learner, the teacher, and 
the program. 

• Assessment techniques must be selected to 
provide reliable and valid measurement 
of educational outcomes across a variety 
of teaching environments. 

• Academic health centers, educational pro- 
grams, and accrediting agencies should 
continue to develop monitoring and as- 
sessment approaches that meet the needs 
of different constituencies. 



VII. FINANCING THE EVOLUTION 
OF GRADUATE MEDICAL 
EDUCATION 

FINDING 7 (page 24): The system of funding 
graduate medical education through teach- 
ing hospitals has inherent limitations and 
disincentives that inhibit the development of 
ambulatory experiences and community- 
based educational programs. There is still no 
consensus on how to appropriately fund and 
expand the curriculum to reach into commu- 
nity settings. 



Recommendations: 

• A stable reliable source of funding for 
graduate medical education is essential. 
While it is appropriate to assume that the 
Federal government through the Medicare 
program will continue to support gradu- 
ate medical education, COGME endorses 
efforts to ensure that all payors, includ- 
ing the Federal government, support an 
equitable share of medical education costs. 

• Medical schools, teaching hospitals and 
major stakeholders should prepare to fi- 
nance physician education programs that 
incorporate the changes recommended in 
this report. Most of the funds to support 
these changes will require shifting exist- 
ing internal resources within the academic 
enterprise. 

• Funding for residency programs must 
provide the flexibility to meet the educa- 
tional needs of residents. Program fund- 
ing should be structured to enable resi- 
dents to attain the knowledge, skills, 
attitudes and values that will meet both 
the profession’s goals and community 
needs. 

• The value of graduate medical education 
to the sponsoring institution should be 
determined through a candid and explicit 
assessment of its financial, educational, 
and service contribution to the achieve- 
ment of the institution’s mission. 



VIII. SUSTAINING QUALITY AND 
VITALITY IN MEDICAL 
EDUCATION 

FINDING 8 (page 26): Creating and sustain- 
ing the educational changes required to re- 
spond to the changing medical environment 
will continue to be a challenge given the 
pressures of the medical marketplace and 
the complex missions of medical schools, 
academic medical centers and other teach- 
ing hospitals. 



Recommendations: 

» Medical schools, residency training pro- 
grams, and teaching hospitals must bal- 
ance their competing roles and reaffirm 
their educational mission. They should 
embrace the task of meeting societal need 
through the education of their graduates. 
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• The standards for accreditation and fi- 
nancial support of residency programs should 
be revised to encourage and facilitate new 



curriculum content, and opportunities to 
acquire additional knowledge, skills, atti- 
tudes and values. 
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THE CHANGING PRACTICE OF 
MEDICINE 

The practice of medicine has been transformed 
in the last decade and the pace of change shows no 
signs of lessening. This transformation reflects ad- 
aptation both to the burgeoning scientific and tech- 
nical abilities of medicine and to dramatic devel- 
opments in demographic, social, political, and 
cultural aspects of health. Rapid progress in re- 
search and technology continues to expand the 
power of medical treatment, redefine fundamental 
understandings and practices, and raise expectations 
of the medical system. Simultaneously, a more di- 
verse and sophisticated society is questioning what 
constitutes “health” and how we value its acquisi- 
tion and maintenance. These complex interactions 
have many important dimensions, but organiza- 
tional and financial influences have proved particu- 
larly pervasive. The public now expects depend- 
able professional expertise from physicians and 
other members of the health care team in systems 
that are comfortable, affordable, and accessible. 

Within the physician encounter itself, the com- 
bination of “high tech and high touch” is increas- 
ingly valued. Physicians are expected to appreci- 
ate the patient perspective, communicate effectively, 
and to maintain an uncompromising mastery of ap- 
propriate scientific and clinical advances. Physi- 
cians are held accountable for their services to an 
extent not previously imagined. This accountabil- 
ity goes beyond the outcomes of technical aspects 
of care to include service-oriented dimensions such 
as communication and patient satisfaction. Ac- 
countability for costs and the necessity to demon- 
strate value in patient care activities are now al- 
most universal. 

Financial factors play a significant and com- 
plex role in the changing practice of medicine. Pro- 
found changes have occurred in the methods used 
to finance health care. Pre-payment and managed 
care models have become firmly established and in 
many areas have replaced fee-for-service as the 
dominant financial models. In 1996, over 77 mil- 
lion Americans were enrolled in one form of man- 
aged care, Health Maintenance Organizations 
(HMOs), and the “HMO penetration” was reported 
to range from nearly 60% in Delaware to under two 
percent in Mississippi with a U.S. average of 29% 
(Managed Care Digest Series, 1997). Enrollment 
in HMOs rose by 14.4% between 1995 and 1996 
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and growth of various forms of managed care is 
projected to continue (Rivo, Mays, Katzoff, Kindig, 
1995). As recently stated by this Council, more than 
two thirds of the population could be participants 
in managed care by the end of the century and it is 
possible that current medical students may never 
experience a fee-for-service practice (COGME Re- 
source Paper, 1997). 

Most pre-payment models are based on the con- 
cepts of “managed care”. This term applies to a 
heterogeneous and rapidly-evolving group of or- 
ganizations providing diverse health care programs, 
which share the common attribute of linking the 
financing and delivery of health care (Iglehart, 
1992). A common feature is that selected health 
professionals and organizations furnish an estab- 
lished set of services to a defined population for a 
predetermined cost, in a system with significant uti- 
lization and quality control mechanisms. Managed 
care organizations encompass a spectrum from 
highly-capitated staff model systems that own fa- 
cilities and employ physicians, to organizations that 
contract with independent physicians, hospitals, and 
other agencies for specific services. 

Recent trends have modified the original mod- 
els of managed care and have favored plans that 
offer greater flexibility. The number of staff-model 
HMOs has shown a steady decline from 66 in 1989 
to 46 in 1996, whereas the number of network- 
model HMOs and Independent Practice Associa- 
tions (IPAs) has continued to rise. Approximately 
two-thirds of current HMOs are IPAs (Managed 
Care Digest Series, 1997). The parameters set by 
the core features (specified services and providers, 
defined population, predetermined costs, and utili- 
zation and quality control mechanisms) are likely 
to endure even in the rapidly-changing health care 
market. Further evolution of managed care models 
will depend not only on the desires of patients and 
health care professionals, but also on the interests 
of employers, legislators, and investors. Arrange- 
ments in which physicians’ incomes are linked to 
their ability to provide cost-effective care will prob- 
ably persist, but patient satisfaction and other non- 
traditional measures of the quality of physician 
services are likely to become integral to the calcu- 
lation of physician rewards. Similarly, future com- 
petition between plans may not be based exclusively 
on costs but include concepts from the “service sec- 
tor” such as quality, value, service, and patient sat- 
isfaction. (O’Connor, Solberg, Baird, 1998). The 
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emphasis on primary care and ambulatory services 
with a concomitant reduction in the rate and dura- 
tion of hospital admissions is unlikely to disappear 
even in a rapidly-changing and unpredictable envi- 
ronment. Conversely, the emphasis on health 
screening, preventive services, and wellness of in- 
dividuals and communities (COGME Resource 
Paper, 1997) may be challenged as patient switch- 
ing between plans negates the long-term financial 
incentive to avoid future illness. 

Although the eventual outcomes of market and 
other forces are hard to predict, cost containment 
will clearly continue to be a feature of health care 
delivery systems. It also appears certain that most 
physicians in the future will interact with some form 
of managed care. The relationships between physi- 
cians and managed care organizations or similar 
organizations are likely to cover a spectrum from 
physicians in the role of employees to contractual 
or more distant relationships. 

EVOLVING CURRICULA IN 
MEDICAL EDUCATION 

Changes in medical practice have profound 
implications for physician education. In 1995, the 
Pew Commission called on educational institutions 
to lead rather than react to changes in the health 
care system: 

“There exists an overwhelming need for new 
emphases in health professions education to 
address the emerging and evolving health care 
system . . . educational institutions must lead 
the change process , and indeed in so doing 
both help developing practitioners form the 
values that define their profession and rein- 
terpret those values as the configurations and 
demands of the health care system change 

Innovative and creative programs are required 
to ensure that the preparation of physicians for the 
realities of future practice is based upon knowledge, 
skills, attitudes, and behaviors that reflect the high- 
est professional standards and traditions. 

Medical education reform has been proposed 
and documented in several reports published dur- 
ing the past two decades. Each report has advocated 
specific changes and acknowledged the complexi- 
ties and difficulties of continuously updating medi- 
cal education, particularly the long time scale of 
seven-ten years to acquire professional qualifica- 
tions. The importance of volunteer faculty was only 
one element stressed in the comprehensive “Future 
Directions for Medical Education” report by the 
American Medical Association (AMA) in 1 982. The 
1984 report of the Association of American Medi- 



cal Colleges (AAMC) on the “General Professional 
Education of the Physician: Physicians for the 21 st 
Century” (GPEP) also addressed the need for revi- 
sion of the content and process of medical educa- 
tion, and drew particular attention to the relation- 
ship between the numbers, specialties, and skills 
of physicians trained and the projected needs of the 
population. The challenge of preparing physicians 
for lifelong practice during times of exponential 
scientific advances was one of several themes in 
two reports sponsored by the Macy Foundation 
(1983 and 1988). In spite of considerable study and 
activity, the comprehensive review, “Assessing 
Change in Medical Education: the Road to Imple- 
mentation” (ACME-TR1) concluded that by 1990, 
medical schools had responded unevenly to the call 
for educational change and the overall pace of 
change had been slow. The ACME-TR1 report iden- 
tified major barriers to change and suggested strat- 
egies by which both medical schools and related 
organizations could improve medical education. 

Recent years have seen considerable changes 
in the content of curricula for medical students and 
residents and substantial innovations in the meth- 
ods used in medical education. Two recurrent 
themes of particular relevance to this report have 
been the importance of “align(ing) the content of 
medical education programs with evolving societal 
needs, practice patterns, and scientific develop- 
ments” (MSOP:Report II, 1998); and an increas- 
ing appreciation of the role of measurable learning 
objectives to guide the design, content, and con- 
duct of educational programs (Kassebaum, Eaglen 
Cutler, 1997). The ambitious Medical Schools Ob- 
jectives Project (MSOP) of the Association of 
American Medical Colleges (AAMC) aims to de- 
velop a national consensus on the attributes of medi- 
cal graduates and to articulate these attributes as 
learning objectives applicable to curricula in indi- 
vidual medical schools (MSOP Report I, 1998). In 
the more diverse area of graduate medical educa- 
tion, accreditation and review processes have in- 
creasingly stressed attainment of measurable learn- 
ing objectives and documentation of competencies. 

Both ACME-TRI (1992) and the Pew Health 
Professions Commission (1995) emphasized that 
addressing the problems in medical education re- 
quired profound institutional change. The Pew 
Commission stated: 

“Changing health professions education 
to meet today *s challenges , however \ will re- 
quire health professions educators to do more 
than add courses on health care delivery, or- 
ganization , and finance , and establish clini- 
cal training experiences in managed care set- 
tings. It will also require them to articulate 
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and demonstrate institutional missions and 
values that are in concert both with the 
nations health care needs and health care 
systems directions; fundamentally reform 
core curriculum; develop new political and 
economic partnerships; focus on the needs of 
communities; and strengthen the tools needed 
to effect some institutional change” 

To fulfill their mandate to prepare physicians 
for practice, medical education institutions, there- 
fore, must implement extensive changes which go 
beyond the expected continual updating of curricu- 
lar content to reflect the exponential expansion of 
knowledge in the disciplines and sciences pertinent 
to medical practice. This alone is a daunting task. 
It is now recognized that fundamental changes in 
the organization of medical education are required 
to adequately prepare physicians for modem prac- 
tice. For many reasons, most U.S. medical schools 
and residency programs have revised mission state- 
ments, undergone strategic planning exercises, and/ 
or undertaken organizational re-structuring during 
the last decade - and expect to continue such proc- 
esses. The reaffirmation of education as the “core 
business and unique function” (Cohen, 1997) of 
training programs and the development of strate- 
gies to ensure its success are essential amid the tur- 
moil and competing demands of the healthcare en- 
vironment. 

Finally, in addition to the curricular and orga- 
nizational dimensions noted above, medical student 
and resident programs are undergoing an “educa- 
tional revolution”. Nationwide, traditional curricula 
and teaching methods are being replaced by pro- 
grams based on adult learning principles. These are 
characterized by more intense small group learn- 
ing and stringent evaluation based on a demonstra- 
tion of competencies. Teaching faculty find them- 
selves in a process of “re-engineering” complex 
systems of curriculum design, delivery, and evalu- 
ation while at the same time meeting the expecta- 
tion to lead, or keep abreast of, the scientific devel- 
opments in their individual disciplines. The revision 
of educational programs is an exciting challenge, 
but it is also demanding and exhausting to faculty 
members who are struggling to maintain research 
programs and preserve clinical income. 

CHANGING THE ENW0TONW3ENT 
©F ©LOMDCAL EDUIGAirOON 

The educational reforms outlined above expand 
the combination and synergy of didactic and expe- 
riential learning in medical education. The system, 
especially at the residency level, requires extensive 
participation in patient care. The changing prac- 
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tice of medicine profoundly affects the patient- 
based resources for the education of future physi- 
cians and determines the optimal environment in 
which education should take place. For many func- 
tional, organizational, and cultural reasons, man- 
aged care systems and traditional academic train- 
ing sites have been described as “structurally 
incompatible” (Fox, Wasserman, 1993). 

Teaching institutions have traditionally drawn 
on large patient bases to provide a rich environ- 
ment for education and the integration of didactic 
material with clinical experience. These patient 
bases were sustained by factors such as traditional 
referral patterns, unique availability of services, 
reputation/excellence of patient care, location, or 
patient choice (including lack of alternatives or “no 
choice”). With the transformation of the health care 
market, particularly the introduction of capitated 
programs offering discounted services and choice 
of provider, both privately-insured and publicly- 
funded patients have chosen to seek care elsewhere. 
Conversely patients who lack financial resources 
or those with limited reimbursement for services, 
frequently rely on teaching institutions. These cen- 
ters also provide high-intensity specialist services 
that are needed by the community but are relatively 
unprofitable to other hospitals or clinics. Medical 
students and residents are likely, therefore, to en- 
counter smaller and less diverse patient populations. 
Residency patient populations are increasingly 
skewed towards the indigent (Bethea, Singh, Pobst, 
1996) or patients with unique health needs only 
treated at a teaching hospital. Conversely, teaching 
institutions are less and less likely to serve the pa- 
tient populations representative of those belonging 
to managed care and other evolving health systems. 
The shifts in patient populations pose significant 
problems for teaching institutions seeking to ful- 
fill their mandates and missions to prepare physi- 
cians appropriately for future practice. As summa- 
rized by Schroeder in 1987: 

“As an unintended result of powerful soci- 
etal changes in the organization and delivery 
of medical care , the old model of education in 
a hospital-based system has been made less 
appropriate as the exclusive site for clinical 
education. ” 

The challenges to the educational mission are 
obviously significant, but the changes in patient 
populations and related factors are so pervasive and 
of such a magnitude that they impact the structure 
and financial viability of teaching institutions. As 
teaching institutions lose certain patient groups and 
attract those rejected by other systems, the long- 
standing societal responsibilities for patient care of 
the most vulnerable patients jeopardize the financial 
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support for educational and other missions. The 
“historically mutually beneficial relationship” 
(Houpt, Goode, Anderson et al, 1997) between the 
clinical, teaching, and research missions is hard to 
maintain and, in the current climate, these three 
missions are often at odds with one another and 
economic realities. Declining patient bases in a 
highly competitive and cost conscious marketplace 
place even the most prestigious institutions in jeop- 
ardy. The economic advantage of hospitals with no 
teaching mission has been documented for over a 
decade (Cameron, 1 985) and was recently estimated 
to be as high as 35% per admission even with ad- 
justment for case-mix (Blumenthal, Meyer, 1996). 
In ambulatory care, physicians in the community, 
many of whom have been trained at nearby teach- 
ing hospitals, provide many of the same services at 
lower cost than their academic counterparts. 

Teaching institutions are being fundamentally 
altered by the revolutionary changes occurring in 
health care markets. Paradoxically, the forces that 
have shaped the current health care climate have 
also been those that have most hindered responses 
by education programs (Vanselow, Karalewski 
1986). The health care industry, by creating a more 
competitive marketplace, has had an adverse im- 
pact on the clinical revenue of academic medical 
centers and faculty practice plans. Declining clini- 
cal revenues have, in their turn, reduced the re- 
sources available to subsidize research and teach- 
ing (Jones, Sanderson, 1996). As a consequence, 
physician faculty have found it necessary to devote 
more time to clinical activities and correspondingly 
less time to teaching and research. During this same 
time period, financial support from other sources 
such as State funding, tuition, endowments and re- 
search grants has not significantly increased for 
most teaching institutions (Jones, Ganem, Wiliams, 
Krakower, 1998). Although new funding for re- 
search has been generated in some institutions 
through relationships with industrial partners 
(Blumenthal, 1 996), there is evidence that high lev- 
els of industrial support are associated with reduced 
academic activity (Blumenthal, Campbell, Causino, 
Louis, 1996). In the face of such severe economic 
strictures, the capacity to devote resources to edu- 
cational programs has been questioned (Fogelman, 
Goode, Behrens et al 1 996/Houpt, Goode, Anderson 
et al 1997), and the ability to provide quality in 
undergraduate and graduate programs may be com- 
promised (Rivo, Mays, KatzofT, Kindig, 1 995). Al- 
though there is substantial variation between insti- 
tutions, all studies verify the continued dependence 
of medical schools on faculty-generated revenue 
and the current constraints on academic and other 
enterprises due to adverse market forces (Jones, 
Ganem, Williams, Krakower, 1998). 



Faced with substantial educational challenges 
and decreasing and/or inappropriate resources to 
develop programs, teaching institutions have 
adopted a variety of strategies to preserve patient 
bases for education and other endeavors (Fogelman 
et al, 1 996). A new appreciation of the potential of 
volunteer faculty and community-based locations 
to complement the experiences available in teach- 
ing hospitals is a common theme in the recent lit- 
erature (Fogeleman et al, 1 996/Houpt et al, 1997). 
This trend has also enhanced interest in distance 
learning and methods to make didactic curricular 
elements “portable” for use by learners at commu- 
nity sites. Several programs have been developed 
which provide examples of successful partnerships 
between medical schools and managed care orga- 
nizations for the purpose of educating medical stu- 
dents and residents (Stevens, Leach, Warden, 
Cherniak, 1996/ Moore, Inui, Ludden, 
Schoenbaum, 1994). A study in 1996 estimated that 
about 85% of medical schools potentially exposed 
students to some form of managed care during re- 
quired clinical experiences and that 1 6% of schools 
required experiences in staff/group model HMOs. 
(Veloski, Barzansky, Nash et al, 1996). This coun- 
cil in its Sixth Report (1995) recommended that 
undergraduate and GME programs expand their in- 
volvement with managed care organizations. 

Although teaching institutions are developing 
new models of clinical care internally and building 
new partnerships for education, current learners and 
their teachers are caught in the transition from tra- 
ditional to new models. The gap between the pro- 
grams that prepare learners and the realities of the 
new medical practice environment does not appear 
to be closing. Four factors seem to be confounding 
attempts to close this gap: 

• The pace of change in the practice environ- 
ment; 

• The lag between the introduction of changes 
in educational programs and their impact 
on the practice of medicine (due to the 7-10 
year span of training); 

• The rate of response of medical schools and 
residency training programs to necessary 
curriculum change; and 

• The lack of available resources to support 
needed change. 

Reference has already been made to the first 
two factors. The others reflect the interplay of or- 
ganizational and financial disadvantages under 
which most teaching institutions operate. Teach- 
ing institutions are complex and inflexible business 
erations (Fox, Wasserman, 1993/Houpt et al, 
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1997/Fogelman et al, 1996) that often seek to ful- 
fill their missions under legislative, social, and po-? 
litical constraints which hamper their ability to re- 
spond to change (Allcom, Winship, 1996). While 
they have an obligation to acknowledge and sup- 
port their unique educational mission (Cohen, 
1997), the leadership and faculties of medical 
schools are significantly hampered in so doing by 
financial systems in which distinct budgets for edu- 
cation are rarely identified. 

Uncertainty about the attributable costs of edu- 
cation makes forecasting appropriate budgets for 
change almost impossible (Watson, 1997). Addi- 
tional funding through Federal programs or from 
private foundations could assist in initiating new 
teaching programs but the long-term viability of 
educational activities depends on sustained inter- 
nal fiscal support. In the current climate, it is hard 
to argue for an increase in funding from tuition, or 
from State or Federal sources. In graduate medical 
education, the role of managed care organizations 
and other potential employers of resident physicians 
in providing funding remain controversial (Gold, 
1996). A redistribution of existing resources, par- 
ticularly for graduate medical education which is 
currently strongly linked to hospital service, has 
been advocated (Kassirer, 1996). Although this is a 
significant step, widespread curricular reform is 
unlikely unless educational budgets are developed, 
funds are generated or reallocated, and systems are 
established to monitor financial and other “busi- 
ness” aspects of medical education. 

This is no small agenda for teaching institu- 
tions that are under increasing economic pressure 
on many fronts and may feel abandoned by the com- 
munities and populations they have traditionally 



served. It is equally daunting to faculty who are 
experiencing escalating conflicts in their roles in 
teaching, research, administration, and clinical care. 
Support may be forthcoming from public and other 
stakeholders. In particular, licensing and accredi- 
tation bodies may need to review their requirements 
and add those that promote the acquisition of new 
clinical knowledge and skills needed for 21 st cen- 
tury medical practice (Rivo, Mays, Katzoff, Kindig, 
1995). They may also need to exert pressure for 
greater clarity and accountability in medical edu- 
cation. 

There is a pressing need for physicians whose 
education has prepared them to practice in the new 
healthcare environment. The decade-long lag be- 
tween the introduction of new educational programs 
and their impact on the practice of medicine in the 
community gives rise to a sense of urgency in this 
report. In keeping with the scope and pace of 
change, fundamental and extensive changes in 
medical education are recommended; however, it 
must be stressed that such changes are in the tradi- 
tion of U.S. medical education. Teaching institu- 
tions have been in the vanguard of major trends in 
the medical sciences and practice for over a cen- 
tury (Krauss, Smith, 1997/Pardes, 1997) and right- 
fully claim the intellectual leadership in preparing 
future physicians. When confronted with change 
in the past, they have coped and emerged as strong 
institutions. Their ability to do so will be repeat- 
edly tested (Griner, Blumenthal, 1998). This report 
emphasizes the magnitude of the change posed by 
the tumultuous health care market and establishes 
key issues in how changes should be implemented 
and sustained if the population is to be appropri- 
ately served by its physicians. 
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Medical Education Programs for a Changing Environment 




T he international reputation for excellence of 
American medicine is, in no small part, due 
to the quality of its educational programs. 
This report does not challenge the tradition of qual- 
ity in graduate medical education but seeks to 
strengthen it. The report argues for enhancement 
of existing programs through the inclusion of new 
program content, proposes dramatic changes in the 
faculty structure and roles, and advocates fresh ap- 
proaches to clinical education. Excellence in the 
core disciplines of medicine will always be required 
and the basic scientific method is more important 
than ever in improving the quality of the nation’s 
health. Nevertheless, new content must be inte- 
grated into our teaching programs and new teach- 
ing methods and settings must be explored in order 
to maintain the vigorous traditions of American 
medical education and its insistence on excellence. 
Adding to an already saturated curriculum is a dif- 
ficult task requiring the prioritization and integra- 
tion of both current and new material. Simply add- 
ing to educational mandates and responsibilities has 
always been unsatisfactory and may no longer be 
possible. This report advocates the reorganization 
and modification of current educational programs 
and the exploration of new strategies for medical 
education. It has as its objective, the development 
of programs that effectively prepare physicians for 
medical practice in the changing environment. 
These programs must meet or exceed current stand- 
ards of educational excellence as they prepare resi- 
dents to practice in the more systematic, quality- 
focused health systems of the future (Stevens, 
1997). 

Much of the curricular content of such programs 
has already been defined in the literature. As early 
as 1991, the Pew Health Professions Commission 
published a set of 17 competencies for the future 
health care practitioner (Shugars, O’Neil, Bader, 
1991). Two comprehensive recent reviews 
(COGME 1997 Resource Paper “Preparing Learn- 
ers for Practice in a Managed Care Environment”, 
and Meyer, Potter, Gary, 1997) have developed core 
curricular domains that physicians need to master 
in order to function effectively in new practice en- 
vironments, particularly managed care practice. 
These domains include: 

• Health systems financing, economics, orga- 
nization, and delivery 

• Practice of evidence-based, epidemiologi- 
cally-sound medicine 

22 



• Ethics and the management of dual respon- 
sibilities and conflicts of interest 

• Patient-provider relationships and commu- 
nications 

• Leadership, teamwork, and organizational 
change 

• Quality measurement and improvement 

• Systems based care 

• Medical informatics and the obtaining, as- 
sessment, and use of medical information 

• Teaching managed care 

In this report, the Council focuses on strategies 
for the integration of this content into medical train- 
ing programs. Of the nine domains, two have been 
selected for special consideration. An understand- 
ing of the system in which the physician is provid- 
ing care, and the ability to communicate effectively 
with patients, colleagues, and others are critical in 
today’s medical practice and underpin the full de- 
velopment of the other domains. 

The sections that follow contain eight findings 
and their associated recommendations that are the 
core of this report. They are grouped as follows: 

I. Understanding the System in 
Which Health Care is Delivered 

II. Establishing Practical and Rel- 
evant Teaching Sites 

III. Developing Community Clinician 
Teachers 

IV. Revising the Curriculum Content 
and Learning Process 

V. Reinforcing Communication Skills 

VI. Assuring Quality and Accountabil- 
ity in Physician Education 

VII. Financing the Evolution of Gradu- 
ate Medical Education 

VIII. Sustaining Quality and Vitality in 
Medical Education. 

While the findings and recommendations in this 
report focus on graduate medical education, 
COGME found it difficult, if not impossible, to 
uncouple medical student and resident education. 
We have chosen not to address the issue of fellowship 
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education directly, although the recommendations 
of the report should be extended to include fellow- 
ships. Currently the educational linkages between 
medical school and GME are tenuous. There is lim- 
ited consensus on what aspects of the educational 
experience should be focused at the different stages . 
of the process and little planned attempt to 
synergize learning or avoid unhelpful duplication 
during the long period of training. Medical educa- 
tion should be viewed as a continuum from pre- 
medical education, through medical school, resi- 
dency and fellowship training, and into medical 
practice and continuing medical education. The 
current artificial division of physician education 
into disconnected phases has contributed to some 
of the problems identified here. The lack of conti- 
nuity is manifest at all stages of the training proc- 
ess — between (and even within) courses during 
medical school, in the transition to residency, and in 
establishing and maintaining lifelong practice. 

The fragmentation of the educational process 
has magnified the mismatch between the education 
of physicians and the demands of practice. A sur- 
vey based on the 1 99 1 Pew Commission competen- 
cies found that only 31% of practicing physicians 
reported adequate training to consider cost impli- 
cations of patient care, 17% felt prepared to work 
in managed care settings, and 14% reported being 
well-prepared for increased scrutiny of practice 
standards (Finocchio, Bailiff, Grant, O’Neill, 1995). 

This report is intended to clarify the need for, 
and to stimulate the development of, fresh ap- 
proaches to the professional education of physicians 
for contemporary and future medical practice. It 
presents an analysis of the issues influencing the 
preparation of physicians and recommends changes 
in teaching programs. Unlike previous COGME 
reports which have focused on primary care, the 
recommendations in this report apply to prepara- 
tion for many medical specialties. In particular, the 
importance of clinical education in the community 
is no longer limited to the primary care specialties. 

In many specialties, the community offers unique 
educational opportunities that are complementary 
to those of the academic health center or teaching 
hospital. The comprehensive preparation of all 
modem physicians requires experience in both tra- 
ditional and community settings. 

This report advocates the development of high- 
quality, community-based clinical teaching oppor- 
tunities and a faculty incorporating community cli- 
nician teachers. It calls for expansion and 
enhancement of educational relationships with the 
community and a redefinition of the roles of con- 
ventional medical school and residency program 
faculty. In addition, the report emphasizes the role 
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of rigorous evaluation systems to assure consistent 
quality and guide the steady evolution of educa- 
tional systems. Finally, the report addresses strate- 
gies to fund and sustain the recommended changes. 

I. UNDERSTANDING THE SYSTEM 
IN WHICH HEALTH CARE IS 
DELIVERED 

Finding 1. Physicians increasingly deliver 
health care to defined populations of patients 
in the context of integrated delivery systems 
or health plans . An improved understanding 
of the characteristics of the populations 
served and the attributes of the delivery sys- 
tems is fundamental to effective medical 
practice . 

Many patients now receive health care as part 
of a system that involves physicians, other health 
professionals, hospitals, community resources, and 
a health plan. The resources available to patients 
through a health plan or an integrated health care 
delivery system are often comprehensive; cost-ef- 
fective care is, however, a major theme in almost 
all health care delivery systems and health insur- 
ance plans. Restrictions are usually placed on when 
and how plan-funded services can be used. Con- 
trolling and monitoring access to services is fre- 
quently the role of the plan medical director. Al- 
though this role may be perceived as adversarial to 
colleagues involved in direct patient care, medical 
directors are physicians with expertise in the health 
plan and can be invaluable consultants assisting 
physicians in providing high-quality, cost-effective 
care specific to patients’ needs. 

Effective medical practice within a health care 
system requires communication skills (see Section 
V), effective teamwork built on a clear understand- 
ing of the roles and capabilities of other health pro- 
fessionals, and constructive use of the plan’s re- 
sources and management systems. In order to 
provide the highest quality care and to be advo- 
cates for their patients, physicians must thoroughly 
understand the benefits and limitations of each plan 
and the characteristics of the system in which care 
is delivered. 

Many residency programs have taken steps to 
provide experience in health care financing, prac- 
tice management, and managed care practice. Resi- 
dency programs established within HMOs and other 
managed care organizations are relatively uncom- 
mon but most residents interact with patients who 
are members of pre-paid plans in residency clinics/ 
hospitals or during elective experiences. Managed 
care Medicaid programs are being introduced in a 
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number of States, and may provide residents with 
an opportunity to care for capitated patients in the 
hospital and outpatient clinic. In spite of these de- 
velopments, both residency graduates and the man- 
aged care organizations that they join, currently 
recognize the lack of understanding of the system 
in which they provide healthcare as a barrier to 
immediate effectiveness (Gold, 1996). In this and 
several other key areas, executives of managed care 
organizations have called for far-reaching changes 
in residency curricula to better prepare graduates 
for practice (Jacobs, Mott, 1987/Meyer, Potter, 
Gary, 1997). A recent survey of Internal Medicine 
residents concluded that exposure to managed care 
during residency training influences attitudes to- 
wards acceptance of managed care and career 
choices towards generalism (Nelson, Matthews, 
Patrizio, Cooney, 1998). 

Appropriate preparation in systems of health 
care delivery goes beyond learning about policies, 
procedures and organizational structure. Physicians 
must learn how to optimize the different systems 
for the benefit of their patients and their own sense 
of professional satisfaction. With the advent of 
managed care, the relationship between physicians 
and their patients has changed. Under the fee-for- 
service system, open-ended contracts with health 
insurers permitted physicians to make patient man- 
agement decisions that were not influenced by the 
considerations commonly found in managed care 
programs. Today, many physicians provide care for 
panels of patients who subscribe to a myriad of dif- 
ferent plans, each with different benefits, restric- 
tions, and operational systems. Physicians are of- 
ten placed in the uncomfortable role of explaining 
to patients, who may be employees of the same 
company or even members of the same family, why 
they are not entitled to the same benefits as other 
patients with the same health status. Conversely, 
the population-based approach of health plans pro- 
vides opportunities to enhance the quality of care 
by providing physicians with data on the charac- 
teristics of the patient population, the medical prob- 
lems that are more likely to occur in its members, 
and collaboration in health promotion/disease pre- 
vention measures such as screening. 

In common with other topics and skills de- 
scribed in this report, learning about the system in 
which physicians practice is best accomplished 
through a combination of theoretical studies and 
practical experiences. Intensive short didactic 
courses on aspects of managed care may have lim- 
ited long-term educational impact on residents 
(Lazarus, Foulke, Bell et al, 1998). The emphasis 
on experiential learning in residency training sup- 
ports the direct involvement of residents both in 
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patient care and in processes such as quality assur- 
ance and utilization review that are integral to man- 
aged care organizations. Similarly, experiential 
learning provides opportunities to work with other 
health professionals to learn about their training and 
capabilities, and their role in the clinical team. The 
content and format of educational programs to en- 
hance understanding of health care systems must 
be made specific to the stage of medical education, 
tempered by the predominant form(s) of local health 
care systems. This may range from general over- 
views for first year medical students to details of 
credentialing and contracting which are of great 
significance to senior residents. At all levels of train- 
ing, the requirement to provide optimal patient care 
in the context of the system must be paramount. 

R ecom m en dad ons: ~l 

• Medical students and residents should 
learn the basic principles of health care 
financing, the benefits and limitations of 
typical health plans, and the characteris- 
tics of the systems in which health care 
may be delivered. 

0 The curricula of medical schools and resi- 
dency training programs should include 
clinical learning experiences in the setting 
of each of the components of an integrated 
health care delivery system 

• Medical schools and residency training 
programs should provide opportunities 
for medical students and residents to learn 
the contribution of other health profes- 
sionals to the care of their patients, and 
augment opportunities for learners to par- 
ticipate in a team approach to patient 
care. 

• Educational programs for medical stu- 
dents and residents should address the 
care of the individual patient in the con- 
text of the population or community of 
which the patient is a member. 

iL ESTABLISHING PRACTICAL 
AND RELEVANT TEACHING SITES 

FINDING 2. There will be an acceleration in 
the development of new models of medical 
education that reflect more closely the prac- 
tice of medicine within evolving health sys- 
tems . 

Academic health centers (AHCs) and teaching 
hospitals provide excellent training sites for many 
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aspects of medical education. Indeed for certain 
aspects of clinical learning, the classical AHC is 
the only environment which brings together the 
expertise, selected patients, and the equipment and 
other resources necessary for education. It is, how- 
ever, very difficult in the AHC environment to ex- 
pose students and residents to the patient mix, clini- 
cal situations, pace and time issues, practice 
management concerns, interdisciplinary collabora- 
tion, and physician role models which are preva- 
lent in the community. (Schroeder, 1988) Without 
such exposure, learners are handicapped in devel- 
oping the skills, knowledge and attitudes needed 
for future practice. It is therefore incumbent on 
training programs to include appropriate “non-tra- 
ditional” experiences that complement the AHC and 
teaching hospital components to provide a compre- 
hensive clinical education. In developing this com- 
prehensive approach, consideration must also be 
given to ensuring patient populations which appro- 
priately represent the community diversity in char- 
acteristics such as ethnic origin, socioeconomic sta- 
tus, age, and gender. (Residency training in some 
specialties such as pediatrics, geriatrics, and obstet- 
rics/gynecology should strive for diversity within 
their scope of practice.) 

The national trend in medical education is to- 
wards the attainment of generalist competencies by 
the time of graduation from medical school. These 
objectives are not well served by the specialty- 
skewed environment of a classic AHC. Many, if not 
most, medical schools have acknowledged this by 
creating generalist and other ambulatory experi- 
ences within the AHC and developing new oppor- 
tunities away from the AHC for medical students 
and residents (Cope, Sherman, Robbins, 1996/ 
Carlton, Weston, 1997). They have accepted the 
organizational and other challenges of the ambula- 
tory setting for resident education, recognizing that 
the unique opportunities of the environment require 
new models of graduate education (Wartman, 
O’Sullivan, Cyr 1992). A variety of strategies have 
been used to establish a presence in the commu- 
nity (Urbina, Hickey, McHamey-Brown et al, 1994/ 
Fogleman et al 1996). Some of these strategies 
originated in, or were influenced by, a need to se- 
cure patient populations to support the clinical en- 
terprise of the academic health center. In these cases, 
the operational systems of the clinics may not ex- 
plicitly facilitate education, but all community ac- 
tivity should be seriously considered for its poten- 
tial role in the education of students and residents. 

The established method of experiential learn- 
ing in GME works particularly well when it closely 
parallels future practice settings. The selection of 
appropriate settings for learning is therefore criti- 
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cal. Such settings are more likely to be found in the 
community than in the academic medical center 
(Hayashi, Hayden, Yager, Gauze, 1989/Cope et al, 
1996/Perkoff, 1986/Parenti, Moldow, 1995). As 
medical education has always depended on immers- 
ing the learner in the work environment as a mem- 
ber of a team dedicated to patient care, the com- 
mitment on the part of community sites to 
participate in the education of medical students and 
residents is considerable. A quality educational 
experience demands the investment of time and 
resources by community physicians and staff to 
work with medical school and residency faculty in 
the development, implementation, and evaluation 
of learning experiences. Community sites are part- 
ners and stakeholders in an educational process 
rather than simply locations of an educational ac- 
tivity (Tallia, Micek-Galinat, Formica, 1996). The 
characteristics of a quality community teaching site 
include: 

• The practice of the highest possible quality 
of medicine in an environment that is rel- 
evant to current daily practice; 

• The presence of expert clinician teachers 
who are practicing the highest possible qual- 
ity of medicine; 

• The availability of experiences that are ap- 
propriate to the stage of training of the 
learners and enable them to achieve educa- 
tional objectives of the curriculum; and 

• The presence of clinicians who are prepared 
to devote the time and attention to the learn- 
ing experience for students and residents. 

Of central concern in community settings is the 
need to provide medical education that is of high 
quality and appropriate to the future practice of the 
learner. Each location in which education is con- 
ducted requires individualized preparation, devel- 
opment, and monitoring to fully exploit its educa- 
tional potential (Lemon, Greer, Siegel, 1994/ 
Crump, Chambers, Bolt, 1996). The importance of 
these steps and the resources needed to carry them 
out have been underestimated by many involved in 
medical education (Ricer, Filak, David, 1998). Tra- 
ditionally, medical schools and residency programs 
have made relatively informal arrangements for stu- 
dents and residents at community sites, often based 
on relationships with program graduates and the 
willingness of community physicians to volunteer. 
A comprehensive assessment of the quality and 
scope of the medical practice or the ability of the 
physicians and other staff to teach is rarely con- 
ducted. The increasing significance of community- 
based education has led to more formal agreements 
and, in some locations, the development of 
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educational consortia to bring together entities for 
clinical teaching. Although the costs are enormous, 
some institutions have provided new learning en- 
vironments by direct acquisition or development 
of AHC-owned clinical facilities in the community. 

The introduction of learners into any commu- 
nity site requires careful consideration of strategies 
to anticipate and minimize any negative effects 
while optimizing the positive aspects of participa- 
tion in teaching. The principal concerns are usu- 
ally the slowing of patient flow with its subsequent 
effect on clinical income, and perceptions that pa- 
tients dislike learners participating in clinical en- 
counters. Studies indicate that the time required to 
teach while seeing patients in a private office var- 
ies enormously depending principally on the edu- 
cational stage of the learner and characteristics of 
the teacher (Vinson, Padden, Devera-Sales, 1996/ 
Ricer,Van Home, Filak, 1997). Although it appears 
intuitive, time spent teaching may not directly 
equate to diminished clinical revenue. The few stud- 
ies which have attempted to detect changes in pro- 
ductivity and other financial outcomes due to teach- 
ing have given mixed results (Kearl, Mainous, 1993/ 
Garg, Boero, Christiansen, Booher, 1991/McKee, 
Steiner-Grossman, Burton, Mulvihill, 1998/Fields, 
Tofifler, Bledsoe, 1994/ Heath, Beatty, 1998). It ap- 
pears that experienced teachers in ambulatory clin- 
ics have devised strategies to maintain clinical pro- 
ductivity and income through a combination of 
specific teaching techniques and use of “private 
time” such as during meal breaks or after hours for 
direct interaction with learners. Much of the re- 
search has concerned medical students. Although 
estimates of $6,000-$ 18,000 per year have been 
made of the cost of training a resident in commu- 
nity sites (Zweifler, Rodnick, 1998), a widespread 
belief exists that graduate medical education is a 
“break even” or potential financially positive ac- 
tivity, very dependent on the seniority of the resi- 
dent (Rosborough, 1998/Gold, 1996). The financ- 
ing of resident education in the community is 
extremely complex (Burg, Kelly, Zervanos 1994) 
and certainly merits further study (Xakellis, Gjerde, 
1995/Bordage, Burack, Irby, Stritter, 1998). 

The perception that patients will not accept the 
active participation of students or residents in their 
care is relatively common but generally inaccurate 
(Tamblyn 1994/O’Malley, Omori, Landry, et al, 
1997). The majority of patients are positive about 
the involvement of learners, particularly when des- 
ignation as a teaching site is seen as an indicator of 
high quality practice. Although some patients do 
not want to be seen by learners and others want 
time alone with their physician, many are comfort- 
able participants in clinical teaching when simple 
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courtesy is extended. The opportunity to decline 
the involvement of students and residents must al- 
ways be offered (Simons, Imboden, Martel, 1995/ 
Magrane, Gannon, Miller, 1994/O’Flynn, Spencer, 
Jones, 1997). Improved patient satisfaction has been 
cited as an incentive for HMOs to participate in 
meical education (Kitz, Larsen, 1997). 

Learners also require preparation in order to 
maximize their education in community sites. The 
student or resident who has learned to function ef- 
fectively in the AHC may find the transition to a 
community site stressful and disorienting. They 
may fear isolation from other learners and may be 
required to travel considerable distances from home. 
Community placements usually require learners to 
take greater responsibility for their own studying, 
to act professionally in a situation where the pri- 
mary purpose is patient care, interact with staff and 
other health professionals, and have a very differ- 
ent relationship with teachers than previously. Ex- 
perience in a community site may be a powerful 
counter to the “hidden curriculum” or institutional 
acculturation often cited as a negative influence on 
the professional development of physicians 
(Hafiferty, 1998). Learning in a community office 
may be different in style (Epstein, Cole, Gawinski, 
et al, 1998) as well as clinical content (Gjerde, Levy, 
Xalellis, 1998) from the experience in a residency 
or medical school clinic. Even didactic aspects of 
learning may be different such as use of distance 
learning modalities and an emphasis on personal 
study and completion of projects as opposed to at- 
tending lectures and working with other learners. 
Clear expectations should be set out during the ori- 
entation to the program both at the medical school 
or residency program and “on site.” High levels of 
administrative support and coordination are re- 
quired to optimize the learning opportunities of 
community sites even for residents. 

The importance of clinical education in the 
community is not limited to the primary care spe- 
cialties. In many aspects of surgery, obstetrics and 
gynecology, psychiatry and other specialties, the 
community provides educational opportunities that 
are complementary to those of the academic health 
center. Community sites offer experiences that are 
both practical and relevant to the educational needs 
of the student or resident. This does not imply that 
all clinical learning should be moved into the com- 
munity, but in many instances community sites pro- 
vide essential experiences that are not available in 
the clinics of AHCs. The comprehensive training 
of modem physicians for all specialties requires 
experience in both AHCs and community sites. 

The content and relative proportion of experi- 
ences gained in different environments during the 
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educational process must be decided by each insti- 
tution, but the educational value of community ex- 
periences can no longer be questioned. Learners 
who are placed in such environments are reported 
to have equivalent results on formal testing when 
compared to students educated more convention- 
ally (Fincher, Case, Ripkey, Swanson, 1997/Irby, 
1995/Steiner, Cook, Smith, Curtis, 1998). They are 
also reported to have greater confidence in aspects 
of communication and patient assessment as well 
as a tendency to greater self-reliance in study hab- 
its (Irby, 1995). Medical education must enable stu- 
dents and residents to learn in multiple and diverse 
situations, including the wards, operating rooms, 
clinics and laboratories of the classical AHC; but 
to provide a well-balanced spectrum of learning 
experiences, the proportion of time spent in com- 
munity sites such as private offices, managed care 
facilities, public clinics, community agencies, and 
community hospitals should, in almost all cases, 
be increased. 

Several successful community-teaching pro- 
grams have already been developed. The WWAMI 
program at the University of Washington is an ex- 
ample of a teaching program incorporating selected 
teaching practices distributed across five States 
(Washington, Wyoming, Alaska, Montana and 
Idaho) that offer community-based clinical learn- 
ing opportunities for students and residents. Sev- 
eral of the teaching practices that participate in the 
WWAMI program have done so for 20 years or 
more. Similar programs exist at the University of 
Minnesota, Marshall and West Virginia Universi- 
ties, the University of Kansas-Wichita, and the State 
University of New York, Syracuse. 

More recently, the Health Resources and Serv- 
ices Administration has funded a five-year project 
entitled “Undergraduate Medical Education for the 
21 st Century (UME-21): A Demonstration of Cur- 
riculum Innovations to Keep Pace with a Changing 
Health Care Environment.” The goal of this project 
is to demonstrate that medical schools, in partner- 
ship with managed care and other organizations and 
institutions, can provide educational opportunities 
to better prepare graduates to practice high quality, 
population-based, cost-effective medicine (Wood, 
1998). In addition, under the aegis of Partnerships 
for Quality Education (PQE), a three year initia- 
. tive funded by The Pew Charitable Trusts, 66 
partnerships between academic health centers and 
managed care organizations are developing resi- 
dency training experiences in managed care settings 
(PQE, 1998; personal communication, Gordon T. 
Moore, 1998). The partnership between teaching 
institutions and managed care organizations is per- 
ceived to be mutually beneficial providing educational 



experiences to the medical school and offering the 
managed care partner a role in the education of stu- 
dents and residents who may become future staff 
physicians — but the interactions are complex. By 
one estimate over half of Internal Medicine resi- 
dency programs place residents in private physi- 
cians’ offices for at least a portion of training and 
this proportion is increasing rapidly (Swing, 
Vasilias, 1997). Over 90% of medical schools use 
community preceptors, predominately family phy- 
sicians teaching third and fourth year students, but 
increasingly in diverse roles and throughout the 
curriculum (Fields, Usatine, Stearns, Toffler, 
Vinson, 1998). 

Medical schools, residency programs, and their 
accrediting organizations are rightfully concerned 
about quality and consistency of clinical experi- 
ences for medical students and residents across 
multiple sites in the community. Careful site selec- 
tion, faculty development, and rigorous evaluation 
with feedback are essential. These, and the impor- 
tance of an adequate time placement, well-planned 
to ensure continuity and substantial patient contact, 
have recently been reviewed (Irby, 1995). Distance 
learning technology (discussed later in this report) 
and other methods have been developed to enable 
the didactic aspects of the curriculum to be deliv- 
ered consistently to learners and community clini- 
cians. This concept has been extended to all aspects 
of education as “the Virtual Clinical Campus” 
(Friedman, 1996). Less dramatically, the new em- 
phases on performance assessment of learners and 
evaluation of educational programs provide moni- 
toring and quality enhancement techniques which 
enable medical educators to explore the opportuni- 
ties of unconventional sites with confidence that 
excellence is not being compromised. Indeed it has 
been stated that community-based experiences have 
been more thoroughly evaluated than any other as- 
pect of medical education. 

Recommendations: 

° Clinical education should occur in settings 
that are representative of the environment 
in which graduates will eventually prac- 
tice. Medical schools and residency train- 
ing programs should develop or acquire 
clinical teaching sites that offer the best 
learning opportunities and the highest 
standards of clinical practice. Partner- 
ships with integrated delivery systems, 
health plans and other organizations 
should be developed as one strategy to 
accomplish this. 

• Medical educators should exploit the po- 
tential of distance learning technology to 
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deliver educational programs in which in- 
struction and evaluation are of a consis- 
tent and high standard to multiple settings 
in the community. 

BOB. DEVELOPING COMMUNITY 
CLINICIAN TEACHERS 

Finding 3: The selection and support of cli- 
nician teachers in the community will be- 
come a fundamental priority of medical 
schools and residency training programs. 
The current roles of faculty members based 
at conventional teaching institutions will be 
significantly changed by expanded concepts 
of medical education and more inclusive defi- 
nitions of faculty membership . 

The importance of the teacher has been over- 
shadowed recently in medical education by a focus 
on curricular content. In clinical environments the 
best teachers are expert clinicians who teach by 
example and model the professional characteristics 
that students and residents should emulate (Irby, 
1995). In the process of teaching, they provide fac- 
tual information and demonstrate technical skills, 
but above all, they share the clinical problem-solv- 
ing, integration, and communication skills essen- 
tial to patient care. Faculty at AHCs and teaching 
hospitals are often superb clinical teachers who have 
limited contact with students and residents because 
of competing demands on their time from research, 
administration and service commitments. In these 
situations, residents are commonly given the re- 
sponsibility for much of the clinical teaching of 
students. Residents lack the breadth of experience 
to be satisfactory role models for learners and are 
often pre-occupied with the demands of in-patient 
care. Conversely, although busy in patient care, the 
daily activities of community physicians are fo- 
cused on the factors already identified as essential 
to prepare future physicians. Highly effective cli- 
nician teachers and excellent role models for stu- 
dents and residents should therefore be sought 
among community physicians. This report advo- 
cates the mobilization of community faculty to an 
extent not previously attempted both in numbers 
and in the strength of the relationship with medical 
schools and residency programs. 

Who should be selected for this teaching role? 
They must be, first and foremost, experts in their 
field who practice in environments that are repre- 
sentative of their specialties. They must be physi- 
cians who, by the evaluation of their peers and other 
criteria, are identified as the best clinicians in the 
community. Although not necessarily trained as 
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educators, they should have a passion for the role 
and be willing to participate in faculty development 
activities. Community teachers should be involved 
in both the medical and wider community so learn- 
ers may experience the realities of daily medical 
practice and the lifestyle of a community physi- 
cian. This implies that the community teacher 
should be willing to share personal experiences, 
attitudes and other insights with learners creating a 
very different level of teacher-learner relationship 
than usually exists in medical education. Above all, 
they must be willing partners with faculty based at 
the teaching institution and other community teach- 
ers in a dynamic educational system that is respon- 
sive to changes in the practice of medicine and com- 
mitted to the optimal preparation of future 
physicians. 

Community physicians who currently volunteer 
to teach often have a limited understanding of the 
objectives of the learning experience for students 
or residents and the criteria used to evaluate the 
performance of learners and teachers. This may 
occur because of geographic distance from the 
medical school or residency program, limited con- 
tact with program coordinators, or a lack of involve- 
ment in program development. Simply recruiting 
community physicians to teach is not sufficient. 
Course directors must understand the abilities of 
each community teacher and the extent to which 
those match curricular requirements. Each poten- 
tial teacher possesses a range of knowledge, skills, 
and attitudes determined by factors such as the na- 
ture of the medical practice and the interests and 
aptitude of the individual physician. Where gaps 
occur in the teacher's experience or skills, or there 
is a mismatch with curricular objectives, supple- 
mentary experiences must be found for learners and/ 
or opportunities provided for teachers to develop 
or refine skills (Skeff, Bowen, Irby, 1997). Arrange- 
ments must be made to continuously monitor and 
improve teaching effectiveness over time (Schuster, 
Haggerty, 1994/ DeWitt, Goldberg, Roberts, 1993). 
It is anticipated that students and residents in the 
future will work with multiple community teach- 
ers. Ensuring a comprehensive range of experiences 
for learners will become a major role for course 
and residency program directors. Extremely good 
communication among members of a diverse fac- 
ulty team will be essential (Reynolds, Giardino, 
Onady, Sieigler, 1994). 

All educators must be prepared for and sup- 
ported in their teaching roles. For community prac- 
titioners, teaching skills development is a crucial 
activity (Skeff, Stratos, Mygdal et al, 1997). The 
teaching skills necessary to function in the ambu- 
latory environment are different from those needed 
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in the in-patient setting but techniques to maximize 
the educational value of brief teaching encounters 
have been described for both students and residents 
(McGee, Irby, 199 7/Ferenchick, Simpson, 
Blackman et al, 1997/Neber, Gordon, Meyer, 
Stevens, 1992/ Lesky, Borkan, 1989). Well-de- 
signed faculty development programs can assist 
faculty to master the different components of the 
teaching role. Faculty development must, however, 
be built on assessment of the needs of individual 
teachers. Aspects such as evaluation and providing 
feedback to learners are often particularly troubling 
to community teachers because of the very intimate 
relationship with learners. Significant, continuous 
investment in faculty development is essential to 
ensure that the quality of teaching in the commu- 
nity meets acceptable standards (Quirk, DeWit, 
Lasseretal, 1998). 

The insistence on quality and an ability to mea- 
sure it distinguish the community teachers advo- 
cated in this report from those of the pre-Flexnerian 
era. Medical education during that era was justifi- 
ably criticized for its variability in quality and lack 
of academic rigor. Many students of medicine were 
apprenticed to physicians who were themselves 
poorly and unscientifically trained and were inap- 
propriate role models. Since then the term “appren- 
ticeship” has acquired a pejorative connotation in 
medicine and education outside the AHC or teach- 
ing hospital has been regarded as of dubious qual- 
ity. It is time to challenge these beliefs and advo- 
cate a return to significant community-based 
education to complement the in-patient emphasis 
of the AHC. Sophisticated systems to credential 
physicians based on clinical performance are now 
available (Nash, Markson, Howell, Hildreth, 1993) 
and the assessment of teaching skills has become 
more refined and standardized. Such techniques 
provide medical schools and residency training pro- 
grams with the ability to select and maintain com- 
munity faculty who are experts in their clinical 
fields and offer the best in clinical teaching. New 
insights in medical education support the confi- 
dence of many educators that community based 
faculty can provide the best of classical “appren- 
ticeship” and “mentoring” approaches. Individual 
residents or medical students can be assigned for 
high quality clinical experiences and for a major 
proportion of their clinical education to clinician- 
teachers in community practices (Verby, 1988, 
1991). With scrupulous attention to the attainment 
of defined standards of teaching and learning, the 
apprenticeship holds renewed promise as a viable, 
practical, and rigorous educational experience. 

For community physicians to play their full role 
in clinical teaching, they must be appropriately pre- 



pared, rewarded, and sustained. This implies a de- 
gree of commitment and support from the medical 
school and residency-training program that is cur- 
rently provided in only a few locations. In order to 
recognize the value and ensure accountability for 
the quality of their teaching activities, community 
clinician teachers should be paid and otherwise re- 
warded. The time has passed when altruism and 
enthusiasm alone can be the foundation of a large 
component of professional education. The role that 
community clinician teachers will fill in the edu- 
cation of physicians is too important to be assumed 
by volunteers. Community teachers must be directly 
rewarded (Fields, Usatine, Steams, Toffler, Vinson, 
1998). The system of rewards must be clear and 
related to measures of commitment and quality. The 
specific form of rewards should be determined by 
each institution, incorporating input from the com- 
munity teachers themselves as to what constitutes 
appropriate “value” in recognition of their efforts 
and achievements (Bell, Frey, 1998/Gray, Fine, 
1997/ Fulkerson, Wang-Cheng, 1997). At a mini- 
mum, the reward system should incorporate: 

• Direct payments; 

• “In kind” benefits such as continuing medi- 
cal education credits and access to univer- 
sity facilities and services; 

• Appreciation and recognition functions; 

• Participation in a promotion process that 
recognizes teaching, service and scholar- 
ship; and 

• Ability to participate in the on-going 
devlopment of educational programs 

The later is proposed in full appreciation of its 
implications for traditional teaching institutions. 
Since community teachers will be responsible for 
a significant portion of the clinical teaching mis- 
sion of the medical school or residency program, 
they should understand the mission and participate 
in its development, implementation, and evolution. 
Their contributions should be sought and valued. 
Conversely, sustaining educational standards and 
enthusiasm will be enhanced if community-based 
teachers perceive themselves to provide more than 
“clinical material”. The required degree of quality 
control and commitment can be achieved only 
through true collaboration (Lemon, Yonke, Roe, 
Foley, 1995). 

New levels of partnership with the teaching in- 
stitutions should extend to academic promotion 
systems. A recent survey revealed that even in cli- 
nician-educator academic tracks, the number of 
publications remained an influential determinant 
of promotion (Beasley, 1997). While classical 
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scholarly work should not be discouraged, academic 
promotional policies should be developed to accom- 
modate clinician teachers, including those based 
in the community. The criteria for academic pro- 
motion for such faculty should be based on their 
achievements in their specific roles and measure 
scholarship in broadly-defined terms appropriate to 
these responsibilities (Boyer, 1990). 

The creation of a cadre of community clinician 
teachers will substantially change the role of full- 
time medical school and residency program faculty. 
While they will remain committed to the direct 
teaching of medical students and residents, propor- 
tionately greater amounts of time and effort are 
likely to be required for program design, evaluation, 
management, and development. Traditional faculty 
members based at the AHCs and residency training 
programs are likely to require more sophisticated 
skills in the design, management and evaluation of 
educational programs, as well as in leadership, com- 
munication and other attributes in order to lead in- 
creasingly complex educational systems. The cri- 
teria for academic promotion for such faculty 
should reflect achievements and scholarship appro- 
priate to these responsibilities. More sophisticated 
and reliable measures of “service” as well as edu- 
cational aspects of the faculty role will be needed 
in order to ensure that those faculty members who 
devote their careers to education are not disadvan- 
taged in academic promotion and incentive pay- 
ment/ reward systems. 

In addition to physician faculty, medical schools 
and residency programs need to consider appropri- 
ate roles for professionals from educational back- 
grounds and the enhanced personnel and organiza- 
tional systems required to support a network of 
community-based faculty integrated with those 
based at traditional sites. To assure that educational 
standards are met, evaluation criteria are consis- 
tently applied, and teaching performance is con- 
tinuously evaluated and rewarded in complex suc- 
cessful systems will require moving beyond the 
traditional reliance on one or two dedicated fac- 
ulty members and a course secretary. 



Recommendations: 

Medical schools and residency training 
programs should recruit and support 
community clinician teachers. Faculty 
members at community teaching sites 
should be selected for the quality of their 
medical practice and the excellence of 
their teaching. They should be paid and 
otherwise rewarded for their educational 
activities. Teaching institutions should 




develop mechanisms to involve commu- 
nity faculty in the design and operation 
of educational programs. 

0 Medical school and residency faculty 
should complement their skills as teach- 
ers of students and residents with compe- 
tencies in faculty development and the 
management of educational programs in 
the community. 

° Residency training programs should take 
the lead in the development of rigorous 
practice-based models of graduate medi- 
cal education in which individual or lim- 
ited numbers of residents are assigned to 
physicians in community teaching prac- 
tices. 



W. REVISING THE CURRICULUM 
CONTENT AND LEARNING 
(PROCESS 

FINDING 4: The transformation of the health 
care environment created by changing de- 
mographics , mechanisms of health care fi- 
nancing , and a focus on prevention and 
wellness , has a profound effect on the prac- 
tice of medicine . Reflecting these changes 
in educational programs that prepare medi- 
cal students and residents for their future 
roles requires innovative strategies and new 
resources . 

The transformation of health care has created 
opportunities and challenges for medical educators 
(Cohen, 1995). Recent changes in medical prac- 
tice have stimulated the introduction of new topics 
and the expansion of existing components in the 
curriculum, particularly in areas such as ethics, 
evidence-based medicine, cost-effectiveness, nutri- 
tion, wellness and disease prevention. The chang- 
ing demographics of the population have also cre- 
ated a need for a greater level of cross-cultural 
awareness among the graduates of residency train- 
ing programs. Fundamental understandings of the 
objectives of residency preparation (STFM Task 
Force on training residents for the future, 1986/ 
Burke, Baron, Lemon et al, 1994/ Noble, Bithoney, 
MacDonald et al, 1994) have been revisited and 
updated due to the extent and pace of recent 
changes, particularly the impact of managed care. 

The content that should be added to the cur- 
riculum of medical schools and graduate training 
programs because of managed care is summarized 
in the nine domains found on page 7 of this report. 
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They incorporate most of the topics and skills to be 
found in other managed care curriculum descrip- 
tions. Differences between recommendations for 
curricula may reflect problems in the scope and 
definition of terms as well as controversies over the. 
relative priorities of topics. For example, “the prac- 
tice of evidence-based medicine and population- 
based medicine” (Greenlick, 1992) are frequently 
recommended for addition to the curriculum but 
could be implied from the nine domains listed. 
Similar statements could be made concerning “the 
practice of cost effective health care, the applica- 
tion of principles of community medicine and pub- 
lic health to medical practice, and an understand- 
ing of the system in which health care is delivered.” 
Precise definitions of terms, and uncertainty 
concerning appropriate learning strategies are par- 
ticular issues for other recommended topics such 
as “teamwork skills,” “quality measurement,” and 
“patient advocacy.” The nine domains previously 
listed provide a reasonable basis for comprehen- 
sive preparation for modem practice. Although the 
changing practice of medicine requires that educa- 
tors continually adapt the specific content of train- 
ing programs, the concepts encompassed by these 
nine domains are likely to endure and become 
increasingly pervasive in medical education and 
practice. 

Curricular components that address these do- 
mains have been introduced in many training pro- 
grams. While some educators advocate integration 
of the new material into standard curricular designs 
and others have called for dramatic changes in 
medical education, the involvement of community 
sites features in almost all proposals for the educa- 
tion of future physicians. 

The development of community teaching sites 
offers opportunities to present curricular material 
in “real world” settings using a range of formats. 
Besides organizational complexity, the greatest 
concerns have been those of quality and consis- 
tency. In particular, the extension of teaching into 
the community setting requires creative approaches 
to deliver curricula to residents who are dispersed 
among multiple community sites. Distance learn- 
ing technology offers a potential solution (Spann, 
1998/ Lewis, Bredfeldt, Strode, D’ Arezzo, 1998). 
Medical schools and residency training programs 
are exploiting the Internet and other technologies 
for communication and educational purposes. In 
addition to administrative functions (such as post- 
ing schedules or routine communication) many use 
technology to conduct learning sessions, provide 
learners with exercises and resources* or conduct 
examinations. Telemedicine can be used in clinical 
as well as didactic instruction (Crump, Pfeil, 1995/ 



Crump, Tesson, Montero, 1 997). These uses of tech- 
nology in education, administration, and commu- 
nication are well-established at many teaching in- 
stitutions to support “on campus” activities and 
extension to community sites is increasing. A re- 
cent paper describes the application of a compre- 
hensive “intranet” system to enhance communica- 
tion, administration, education, and other aspects 
of GME across multiple sites (Zucker, White, Fabri, 
Khonsari, 1998). The widespread use of technol- 
ogy will only fulfill its potential in education if all 
participants are comfortable with the necessary 
technology as well as proficient in its use. Support 
services have to accommodate “cultural” as well 
as technological issues (Friedman, Com, Krumrey 
et al, 1998). 

Major changes in educational programs cannot 
be recommended without establishing mechanisms 
to monitor effectiveness and ensure consistent qual- 
ity over place and time (Tallia, Micek-Galinat, 
Formica, 1996). As mentioned in previous sections, 
the teaching and testing of knowledge and skills of 
residents medicine has undergone enormous change 
in the last decade (Gray, 1996). In addition to ad- 
vances in educational psychometrics (particularly 
the more effective use of examination formats), the 
use of standardized patients to simulate patient en- 
counters and multiple-station skills tests, represent 
significant advances in the teaching and testing of 
clinical competencies. Several medical schools have 
participated in consortia to develop standardized 
patient training programs, and to share scripts and 
other materials. Rating scales and scoring systems 
have been developed, tested and validated to the 
extent that the National Board of Medical Examin- 
ers is planning to adopt this methodology, which 
has already been used in licensing in Canada 
(Reznick, Blackmore, Dauphinee et al, 1996). The 
Canadian and other studies demonstrate conclu- 
sively that it can be used effectively for teaching 
and/or testing at multiple sites. It is, therefore, a 
powerful addition to the ability to standardize teach- 
ing and evaluation at community sites. 

Distance learning technology, standardized pa- 
tients, clinical skills testing techniques and other 
educational advances are changing the way in which 
students and residents are educated and evaluated. 
These methodologies have the potential to revolu- 
tionize medical education since they offer the op- 
portunity for students to learn and test at their own 
pace and in locations that more closely meet their 
educational needs. They offer the ability to create 
a curriculum that is “portable” and adaptable to the 
individual student and the unique educational en- 
vironment; but one whose quality is monitored 
closely by program faculty, and whose outcome is 
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validated by the achievement of defined competen- 
cies. When integrated with appropriate faculty de- 
velopment, distance learning technology and stand- 
ardized skills testing techniques permit faculty 
members to teach and evaluate learners as never 
before. The improvements in quality and consis- 
tency over time and place and between instructors, 
enable community teaching to be regarded as a true 
extension of, and complementary to, the programs 
offered at the teaching hospital. The unique learn- 
ing opportunities of community sites can be inte- 
grated into the curriculum without jeopardizing 
educational quality. 

Many medical schools and residency programs 
have already responded to calls for change in the 
education of students and residents. New topics and 
techniques have been introduced but few, if any, 
programs have taken a comprehensive approach. 
Constrained resources have been a factor. Indeed, 
many of the curriculum changes in medical educa- 
tion have been initiated through grants and con- 
tracts from Federal agencies and private foundations 
such as the Robert Wood Johnson Foundation, the 
Pew Charitable Trusts, the Kellogg Foundation, the 
Macy Foundation and the Culpepper Foundation. 
Examples include the Robert Wood Johnson “Gen- 
eralist Initiative,” the Bureau of Health Professions 
administration of Title VII programs (Politzer, 
1997), and the “Interdisciplinary Generalist Clerk- 
ship” project (Wartman, Davis, Wilson et al, 1998). 
Without the availability of resources such as these, 
much less might have been accomplished. 

In spite of these initiatives and changes, sev- 
eral recent reports have pointed out the discrepancy 
between the education of physicians and the knowl- 
edge, skills and attitudes required for successful 
practice (Finocchio, Bailiff, Grant, O’Neil, 1995). 
Graduates of residency training programs in the 
U.S. have been critical of their preparation for medi- 
cal practice in the community, particularly in areas 
such as practice management, and the care of spe- 
cific chronic conditions in community settings 
(Cantor, Baker, Huges, 1993). The health care in- 
dustry has been equally critical of medical educa- 
tion (Gumbiner/Gold, 1996). Managed care orga- 
nizations have identified shortcomings among 
newly-hired physicians, particularly in communi- 
cation skills and the practice of cost-effective medi- 
cine. They advocate a much greater emphasis on 
primary care in the education of all physicians and 
are critical of the high proportion of graduates who 
select subspecialist careers. 

As stated above, proposals for topics to be in- 
cluded in a curriculum which appropriately prepares 
graduates for managed care practice have been pub- 
lished. Much less has been published concerning 
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how these topics should be integrated into the cur- 
ricula of medical schools and residency training 
programs. Some of the elements of a managed care 
curriculum may already be present in the offerings 
of many medical schools and residency training 
programs. In such cases, coordination and integra- 
tion of existing components are required to appro- 
priately prepare graduates for practice. It is likely, 
however, that many institutions require extensive 
curriculum revision (of both content and format) 
in order to enable their graduates to achieve the 
competencies identified as essential for practice in 
contemporary and future environments. Again, this 
report emphasizes the need for access to a compre- 
hensive range of traditional and non-traditional sites 
for medical education and the integration of didac- 
tic and practical experience in order to prepare a 
competent physician. Medical school and residency 
training program faculties should evaluate and re- 
vise current curricula to ensure that these topics are 
introduced at the appropriate time in the education 
of medical students and residents, and that they are 
given emphasis and reinforcement throughout the 
program. Many aspects of these domains can best 
be learned in non-AHC settings. Indeed, some top- 
ics can only be effectively taught and role-mod- 
eled in community practices or specific sites such 
as public health agencies or the administrative of- 
fices of health care delivery systems. As previously 
stated, a comprehensive medical education increas- 
ingly requires experience in a range of non-tradi- 
tional learning environments. Some of these sites 
may not directly provide patient care and examples 
already exist of student and residency rotations in 
administrative offices of managed care organiza- 
tions or public health officers. 

It is anticipated that institutions will continue 
to develop different strategies to fulfill their man- 
dates to appropriately educate physicians for fu- 
ture practice. The evolving significance of commu- 
nity sites is such a consistent and powerful theme 
that all educational models are expected to incor- 
porate community experiences and in some insti- 
tutions, such experiences could account for substan- 
tial portions of the curriculum. The expanded role 
of community-based education is likely to enhance 
other developments such as electronic and other 
non-traditional teaching methods, competency- 
based curricula, and standardization of testing and 
evaluation. The patient populations and clinical 
experiences provided by community sites are also 
likely to further accelerate changes in curricular 
content towards those domains identified as cru- 
cial to future practice environments. Within these 
domains, communication skills (Section V.) and 
understanding of health care delivery systems (Sec- 
tion I.) are perceived to be of particular significance. 
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Recommendations: 

° Medical schools and residency training 
programs should fundamentally revise the 
preparation of their graduates to reflect 
the changing practice environment while 
sustaining the quality of current teaching 
programs. They should emphasize disci- 
plines that are basic to contemporary 
medical practice such as epidemiology 
and population-based care, health care 
policy and systems, disease prevention and 
wellness, and computer information skills. 

• Educational programs must prepare phy- 
sicians in ethical decision-making and ad- 
vanced communication skills, including 
patient advocacy, conflict resolution, and 
teamwork to effectively serve patients in 
the new health care systems. 

• Medical schools and residency training 
programs should accelerate the incorpo- 
ration of advanced educational concepts 
and techniques such as distance learning, 
standardized patients, and psychometrics 
in order to enhance the quality and con- 
sistency of educational programs. 



Wo REINFORCING 
COMMUNICATION SKILLS 

FINDING 5. An increasingly diverse patient 
population and a changing health care envi- 
ronment magnify the need for effective com- 
munication by physicians. 

Communication is a crucial factor in modem 
medical practice. In emerging health systems, three 
areas of enhanced importance have been identified 
i.e. clinician-patient, clinician-clinician, and clini- 
cian-community (Tresolini, Pew-FetzerTask Force, 
1994) and the complexity of each area developed 
(Inui, 1996). 

Communication with patients involves much 
more than taking a medical history or conducting a 
clinical interview. It concerns communicating an 
understanding of lifestyle, health and illness with 
the patient and others and the integration of socio- 
cultural factors into practice (Bolman, 1995). Ef- 
fective communication not only enhances accuracy 
of diagnosis and treatment but also builds produc- 
tive therapeutic relationships, encourages patient 
compliance and self-care, and enhances patient sat- 
isfaction with the physician (Kaplan, Siegel, Madill, 
Epstein, 1997/Marvel, Doherty, Weiner, 1998). In 
particular, residents must be skilled in many aspects 



of communication in order to effectively serve pa- 
tients of diverse cultural and ethnic backgrounds. 
Effective clinical communication with such patients 
goes far beyond language comprehension (STFM 
Task Force, 1986/ Lurie, Yergan, 1990). Curricula 
have been developed to assist programs to ensure 
that all residents master the general principles of 
communication and cultural competency (Like, 
Steiner, Rubel, 1996). Mastery of general principles 
is stressed as the increasingly diverse U.S. popula- 
tion makes it unlikely that any one physician will 
develop true cultural competence for all of the pa- 
tients he/she encounters (Zweifler, Gonzalez, 1 998). 
The study of literature in medical education has also 
been advocated as a powerful means to enhance 
cultural competency and improve communication 
skills (Hunter, Charon, Coulehan, 1995). 

Most understandings of physician-patient com- 
munication are based on physicians controlling 
medical knowledge and dominating therapeutic 
decisions. A recent development concerns commu- 
nication with patients who are increasingly sophis- 
ticated “consumers” of health care and may have 
unparalleled access to medical information through 
electronic systems. The dangers of indiscriminate 
health information and recommendations, particu- 
larly on the World Wide Web are well recognized 
(Silberg, Llundberg, Musacchio, 1997) and recom- 
mendations have been made on using “information 
therapy” as a positive force in patient care (Bader, 
Braude, 1998). At a minimum, residents should 
know if their patients ’ usual sources of information 
and influence include electronic systems. 

As medical practice is increasingly based on 
teamwork between individuals trained in different 
health professions as well as between physicians 
in different specialties, unambiguous and appropri- 
ate communication between colleagues is also as- 
suming greater significance. In this area, too, elec- 
tronic systems are beginning to be used in what was 
exclusively a verbal or written system with its own 
conventions (Bergus, Sinift, Randall, Rosenthall, 
1998). Aspects of communication between col- 
leagues include the understanding of team dynam- 
ics, and the facilitation of contributions by others 
as well as the articulate presentation of individual 
contributions (Inui, 1996). Certain systems of health 
care may place particular strains on specific rela- 
tionships such as the consultation/referral relation- 
ship between generalist and subspecialist physi- 
cians, and the relationship between the physician 
providing direct patient care and one with respon- 
sibility for utilization review. The physician’s role 
as a patient advocate adds a further dimension to 
communication skills. Effective interaction with the 
medical director of a managed care organization, a 
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hospital administrator, or with a community health 
care agency, requires skills that are rarely addressed 
in the educational process. Advocacy and conflict 
resolution become critical skills (Noble, Bethany, 
Macdonald et al, 1994) and, in parallel with them, 
medical ethics and resource allocation assume much 
more important roles. 

Enhanced clinician-community interaction is 
valued by integrated health systems both to pro- 
mote the concept of a member or patient commu- 
nity as defined by membership of the organization, 
and to affect major community health issues (Inui, 
1996/Greenlick, 1992). The study of wellness and 
preventive medicine, population-based medicine, 
and community health advocated by many propo- 
nents of curriculum change imply an enhanced role 
in the future for physicians as educators of the com- 
munities and populations that they serve. If this 
responsibility is to be effectively carried out, addi- 
tional skills will be required to communicate to 
large groups, including effective use of television, 
radio and other communication media. Physicians 
will also need to acquire the ability to interact ef- 
fectively in a leadership role with health care ad- 
ministrators, politicians, and other community lead- 
ers. 

Preparation of residents in communication must 
incorporate the use of multiple formats, technolo- 
gies, and media. As already mentioned, communi- 
cation in the era of the computer takes on new di- 
mensions. The use of electronic communication has 
become a standard in many institutions among phy- 
sicians in practice in the community. Some patients 
already use this method to communicate with their 
physicians, and physicians are using it to commu- 
nicate with colleagues, health plans and hospitals. 
The legal and ethical implications of this revolu- 
tion, particularly regarding confidentiality, remain 
problematic. Another feature of communication is 
access to professional information. Most hospital 
medical libraries and many physician offices now 
have access to the medical literature searching ca- 
pabilities of the World Wide Web. The use of this 
technology is expanding exponentially as both phy- 
sicians and their patients grow to understand the 
power of immediate availability of almost unlim- 
ited information. Many medical schools have in- 
troduced courses on medical informatics and other 
aspects of the technological revolution in commu- 
nications. Equally important, but not always linked 
to such courses, is the growing curricular interest 
in Evidence Based Medicine (EBM). Most EBM 
courses stress the evaluation of medical informa- 
tion and provide practical assistance in distilling 
relevant and useful clinical information from the 
overwhelming volume of medical literature. With- 



out a grounding in EBM, residents are poorly pre- 
pared to evaluate new and existing information or 
to understand and use clinical pathways, guidelines, 
or recommendations for patient care. 

Another critical aspect of communication for- 
mats concerns clinical documentation. Experimen- 
tation with the electronic medical record is con- 
tinuing in many locations. The prospect of a medical 
record that could be almost instantly available at 
any location is no longer a figment of the imagina- 
tion. Within a few years, this technological advance 
will be in widespread use, and will raise issues such 
as confidentiality to new levels. 

In all dimensions, verbal and written commu- 
nication will continue to be essential skills for 
physicians. Comments from the health care indus- 
try, and from the human resources departments of 
companies purchasing health care plans for their 
employees indicate that poor physician/patient 
communication skills are one of the most trouble- 
some and recurring problems that they face today 
(Gumbiner, 1994). The Medical School Objectives 
Project (AAMC/MSOP Report I, 1998) drew atten- 
tion to multiple aspects of communication as es- 
sential competencies for graduating physicians and 
prepared a detailed monograph on medical 
informatics and aspects of community responsibili- 
ties (AAMC/MSOP Report II, 1998). In recent years 
there have been renewed efforts in the teaching, 
refinement and evaluation of communication skills 
(MSOP, 1998/Kaplan, 1997) and standardized pa- 
tients are frequently used for both teaching and as- 
sessment of skills. Communication and related top- 
ics have been prominent in recent reforms of 
preclinical education (Curry, Makoul, 1998) but less 
has been published concerning their integration into 
subsequent training, or the retention/influence of 
such preclinical courses on residents’ behaviors. 
Good progress has been made but much remains to 
be accomplished. The continuing complaints of 
consumers of health care are difficult to ignore and 
are likely to increase as changing population de- 
mographics bring physicians into contact with in- 
creasingly diverse patient populations. 

Progress in the teaching of communication 
skills is an encouraging trend. However, such in- 
struction frequently ends as medical students be- 
gin their first intensive clinical experiences and is 
revisited infrequently, if at all, during the remain- 
der of medical school and residency training. Con- 
tinuous reinforcement of communication skills, in 
every current and future modality, is needed 
throughout all four years of medical school, for the 
duration of residency training and into the setting 
of medical practice. The most advanced evidence 
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of commitment to communications skills as inte- 
gral to the practice of quality medicine would in- 
volve the establishment of competency-based cur- 
ricula with rigorous testing mechanisms to verify 
mastery of specified skills. 

Recommendations : 

• Instruction in and assessment of commu- 
nication skills, particularly related to the 
medical history, should be strengthened 
and expanded to ensure an emphasis 
equal to other major courses and topics. 

• The development and augmentation of 
communication skills with patients, in- 
cluding those from differing cultural 
backgrounds, and with colleagues, admin- 
istrators, and others should be continued 
throughout medical school and residency 
training. 

• Physicians should be prepared in a broad 
range of communications skills appropri- 
ate for use with individuals and groups 
and utilizing a diversity of media. An em- 
phasis should be provided on continually 
updating skills to adapt to rapidly-evolv- 
ing circumstances and technology. 



¥1- ASSURING QUALITY AEMD 
ACCOUNTABILITY IN PHYSICIAN 
EDUCATION 

FINDING 6: The assurance of consistent qual- 
ity in medical education will become increas- 
ingly critical as clinical teaching outside the 
traditional hospital setting expands and as 
teaching strategies become more diverse. 
Methods designed to assess performance 
evaluation at multiple sites and assure the 
longitudinal development of knowledge , 
skills , and attitudes are becoming increas- 
ingly important. 

The necessity of achieving and sustaining the 
highest standards of physician education is the ba- 
sis of this report and underlies each recommenda- 
tion. The nature of medical education requires that 
quality must not only be achieved but that its im- 
mediate and long-term impacts must be documented 
and demonstrated to various constituencies, both 
internally and outside traditional medical educa- 
tion circles. Establishing education in non-tradi- 
tional settings results in particular pressures to dem- 
onstrate both quality and credibility. As early as 
1986, the AAMC concluded that continued societal 
support for medical education depends on systems 



which fulfill society’s expectations in the produc- 
tion of skilled and qualified physicians and pro- 
vide evidence that this is the case. Specifically, the 
report (AAMC 1986) notes: 

® The medical education community should 
continue to monitor the quality of its resi- 
dency training and provide assurances that 
graduates of its residency programs are 
adequately prepared for practice. 

0 The institutions receiving funding should 
recognize their obligations to train the types 
of physicians needed by society. 

0 These institutions also must recognize their 
obligation to operate the training programs 
in a cost-effective manner. 

In recent years, the documentation of abilities, 
frequently in terms of demonstrable competencies 
in specific skills and mastery of cognitive knowl- 
edge, has become pervasive in medical practice. 
Examples include requirements to regularly re-es- 
tablish specialty status (“re-certification”), 
credentialing processes mandated by various orga- 
nizations, and the extensive review systems im- 
posed to grant staff privileges by hospitals and 
medical centers. Clearly physicians face increas- 
ing requirements to achieve and document specific 
attributes of their knowledge and clinical practices. 
Medical schools and residency programs must pre- 
pare learners for the expanding role of evaluation 
and accountability in the practice of medicine. In- 
corporating such systems in the clinical and edu- 
cational programs of medical schools and residency 
programs has both intrinsic and educational value. 

Medical educators have to demonstrate the 
quality of their outcomes to at least three constitu- 
encies i.e. the learners, the sponsoring institution, 
and society at large. Medical learners should be 
confident that what they are taught will provide 
them the knowledge, skills, and other resources to 
meet their current and future responsibilities and 
aspirations. Faculty and institutions require continu- 
ous evaluative data to monitor and improve all as- 
pects of programs, including their value in terms 
of educational gain for resources invested. Mem- 
bers of society at large are entitled to evidence that 
the educational programs they are supporting will 
appropriately prepare physicians for the needs of 
the community. The various constituencies have 
differing informational needs. As educational pro- 
grams become more diverse and community set- 
tings more extensively utilized, the process of evalu- 
ation becomes increasingly complex (Glassick, 
Huber, Maeroff, 1997). 

Conventional evaluation systems resemble the 
classical clinical method that proceeds in a logical 
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sequence to select the most probable diagnosis or 
effective course of action from data and continu- 
ally re-evaluates findings in order to make the op- 
timal decisions. In these apparently linear and logi- 
cal systems, it is relatively easy to establish 
benchmarks for education and establish processes 
for evaluation of learning. The environment of mod- 
em medicine, however, is moving at a rapid pace, 
opening new and sometimes unpredicted variations 
of the classical model. To exploit the environment 
fully, future physicians must develop life-long 
learning skills and have a high tolerance for change 
and ambiguity (Hunter, Charon, Coulehan, 1995/ 
Bundner, 1962). Physicians must be prepared for 
much less predictable models of practice. Estab- 
lishing benchmarks for quality in these new prac- 
tice environments is challenging and controversial. 
In turn, strategies to evaluate educational programs 
must address the complexities that are encountered 
in a wide variety of practice models. Even if the 
technical issues of developing appropriate learn- 
ing benchmarks and process of educational evalu- 
ation can be resolved, problems of objectivity re- 
main. In the new educational models the traditional 
teacher-student relationship becomes more of an 
apprenticeship experience, thus potentially compro- 
mising objectivity in evaluation by both learner and 
instructor. 

In newer systems of medical education, multi- 
modal approaches are needed to demonstrate 
progress toward mastery of appropriate competen- 
cies. While some academic centers could modify 
existing strong assessment programs to meet new 
challenges in acquiring and reporting performance 
evidence, other centers need to develop entirely new 
systems. All teaching institutions require continu- 



ous evaluation systems capable of operating in com- 
plex, changing situations to ensure that learners are 
receiving the optimal educational experience and 
that this experience is of consistent quality across 
time and location. Several examples exist, particu- 
larly in predoctoral education, of institutions with 
robust educational objectives and/or specific com- 
petency statements that form the basis for the de- 
velopment of educational programs, allow for docu- 
mentation of learning experiences, and provide 
guidance in the development of outcome indica- 
tors. Of particular importance to residency educa- 
tion is the selection of integrated evaluation sys- 
tems based on educational goals that reflect the 
competencies required in the new practice environ- 
ments and the on-going refinement of educational 
programs to ensure that education remains focused 
and relevant 

One such integrated approach, the Shewhart 
Cycle, incorporates four critical components i.e. 
plan, do, check, and act (see figure 1) into an evalu- 
ation-improvement feedback system. The first com- 
ponent, developing the “plan”, concerns the iden- 
tification of the problem, appropriate audiences, 
optimal outcome indicators and initial strategy. The 
implementation phase (“do”) refers to the perform- 
ance of the selected strategy. “Check” involves the 
comparison of the achieved and expected outcomes 
with a strong emphasis on identifying areas for pro- 
gram improvement. The fourth step (“act”) refers 
to incorporation of improvements to raise the stand- 
ards of the entire process. Although often illustrated 
as a static cycle, the process is best conceptualized as 
a spiral with each stage driven by commitment to learn- 
ing from experience in order to achieve a truly con- 
tinuous system of improvement. The similarities 



Figure 1 

Similarities BetweenThree Integrated Evaluation Systems 
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Classical Approach to 
Patient Care 
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between the Shewhart Cycle, the classical approach 
to patient care, and the competency-based educa- 
tional system are illustrated in Figure 1. 

From the learner’s perspective, testing (“check” 
or “evaluation”) provides verification that compe- 
tencies are met, insights as to how educational ob- 
jectives could be re-formulated to achieve higher 
levels of performance, and (in the case of a dis- 
crepancy between expected outcomes and those 
achieved) guidance as to remediation. For the edu- 
cator, the approach enlightens each stage of the 
process: 

- do the specific objectives collectively achieve 
the program goals? 

- what competencies/outcomes most effec- 
tively assess attainment of objectives? 

- which programs/processes most effectively 
and efficiently achieve objectives? 

- is the evaluation valid, repeatable, efficient? 

- what does the evaluation reveal about poten- 
tial improvement of the system? 

Evaluation methods are needed that benefit 
learners and educators directly (and other constitu- 
encies indirectly) by providing data-driven valida- 
tion and guidance for improvement. For learners, 
validation reports can potentially be used both im- 
mediately and on graduation as evidence for 



Table 1 

Sample of Context & Evaluator Effect 
Upon Outcome Indicators 

Educational Objective: “The learner will conduct an 
appropriate initial medical history.” 

Context/evaluator Potential Outcome Indicators 



Faculty assessing a junior Are all components of an appropriate 
medical student history included and recorded in a 

systematic fashion? 



Patient responding to a Does the physician ask me all the 

satisfaction survey questions I believe are important to 

understand my condition? 



Faculty evaluating a resident Can the subsequent diagnosis and 

treatment plan be supported by the 
medical history? 



credentialing. Learners can also use the system to 
identify areas of weakness, plan more effective 
study programs, and improve selection of 
coursework. For educators, the data validating pro- 
gram quality can be invaluable in both internal and 
external program review and accreditation. The in- 
creasingly precise documentation of potential for 
program improvement can also be used to articu- 
late the need for resources and plan logical pro- 
gram development. 

Clearly, no single approach to the assurance of 
educational quality can be used across all programs 
for all purposes. Successful models are character- 
ized by well-defined intentional outcomes, struc- 
tured unambiguous data collection processes, 
means for identifying discrepancies between cur- 
rent and intended status, and feedback loop sys- 
tems. As the educational program moves into the 
community and the experience is re-defined to take 
advantage of the local environment, the complexi- 
ties of measurement within the educational process 
become apparent. Collection of progress and proc- 
ess data should be unambiguous and equivalent at 
different sites. Data gathered in one site should be 
able to be interpreted in the same manner as data 
gathered from another site. It should be possible to 
combine data from several sites with confidence 
that such compilations will accurately portray sys- 
tem-wide perspectives. Systems should be designed 
to identify and assess discrepancies between cur- 
rent and intended status as a prerequisite to identi- 
fying barriers to success. Finally, intentional feed- 
back loops should be in place to ensure the constant 
flow of information needed to continuously improve 
the system. In fulfilling all these criteria for effec- 
tiveness, the system must also be efficient. Over- 
zealous collection of low-utility data results in sys- 
tems that are too costly and complex to be useful 
and threatens credibility. 

A variety of models for the specification of 
learning objectives exist (Katz, Fulop, 1978/ Patel, 
Evans, Groen, 1989/Lipkin, 1989/ Price, Mitchell, 
1993). Choice of the outcome indicator(s) is highly 
dependent on the context and the evaluator. For 
example, the educational objective “The learner will 
conduct an appropriate initial medical history” 
could be assessed by several different parameters, 
as noted in Table 1. 

Those approaches that are ultimately the most 
effective are characterized by: 

- excellence in selection of objectives and out- 
come measures 



Billing Agent/payer 




Based upon the billing sheet, are the 
appropriate components of the medical 
history appropriately recorded? 

>■' . 



- systems that enable continuous interplay be- 
tween all components of the cycle 

- unambiguous focus on quality improvement 
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Voytovich, Rippey, and Mathews (1986) further 
elaborated the above criteria for effective educa- 
tional evaluative/development systems as: 



timely enough fashion and sufficient detail 
to allow for improvement in subsequent per- 
formance; and 



- Clearly defined objectives delineate the con- 
tent of the curriculum and provide the 
framework for specification of the learning 
experiences; 



- Unambiguous data are used as the basis for 
alterations of the curriculum should there 
be shown to be failures across various learn- 
ers or sites. 



- Public statements of objectives permit both 
teachers and learners to understand and 
agree upon the intent of the curriculum; 

- Evaluation methods can be directly linked 
to the objectives to be attained; 

- Information from evaluation efforts are pro- 
vided to both teachers and learners in a 

Table 2 

Examples of Educational Components and 
Possible Assessment Strategies 



Educational Component 

History taking, physical exam 
skills, interpersonal skills, verbal 
ability, technical facility 

Problem formulation, diagnostic 
reasoning 

Diagnostic and therapeutic strat- 
egies 

Test ordering, prescribing pat- 
terns, cost effectiveness 

Information-seeking 

Basic medical knowledge 

General judgment in care 

Patient management 

Technical abilities 

Range of experience 
Personal characteristics 



Potential Assesments 

Direct observation with patients 
-by faculty 

-by trained observers 
Structured record audits 



Indirect observation using prepared 
algorithms 

Review of patient charts, pharmacy 
and laboratory reports 

Conferences, rounds, journal clubs 

Traditional testing strategies 

Oral review of charts, reports from 
faculty and peers, patient manage- 
ment problems 

Standardized patients, review of pa- 
tient charts 

Standardized patients, evaluation by 
teachers 

Patient logs 

Feedback from staff, patients, fac- 
ulty; attitude measures 



A variety of evaluation strategies are available 
to assess the educational process and its various 
components. The multiple models generally fall into 
two major groups (Scriven, 1967). The Formative 
mode is designed for on-going processes that have 
as their explicit intent to identify and effect change. 
The Summative mode is undertaken at the conclu- 
sion of a process and is used to determine if the 
specific objectives and/or standards have been 
achieved. The emphasis on feedback even in the 
validating summative models makes them oppor- 
tunities for learning and growth of the curriculum. 
The selection of an individual strategy may be in- 
fluenced by many factors including the environ- 
ment, stage of evolution of the curriculum, degree 
of precision required, or availability of resources. 
Although increasing emphasis is being placed on 
objective and scientifically-measurable evaluation 
techniques, the nature of medicine will continue to 
require some role for subjective evaluations. Even 
in the traditionally “subjective” areas such as feed- 
back from students, peers, patients, and others, in- 
sights from education and other disciplines are lead- 
ing to greater quantification, reliability and 
reproducibility of data. Examples of educational 
components and possible assessment strategies are 
illustrated in Table 2 (Glaser, 1963). 

Evaluation is an essential and rapidly-develop- 
ing component of medical education. Systematic 
scientific evaluation is fundamental to the changes 
advocated in order to prepare physicians for cur- 
rent and future practice environments. Much has 
been achieved, particularly in the adaptation to 
medical education of concepts and practices from 
business and education. Overall, however, the evo- 
lution of appropriate systems has been fragmen- 
tary and dependent on the dedication of individu- 
als and a few institutions. To achieve the scope of 
change in medical education recommended by the 
Council, a greater, more pervasive, and more sys- 
tematic national effort to achieve quality and ac- 
countability in all aspects of medical education is 
necessary. _ 

Recommendations: 

• Medical educators should continuously as- 
sess both short-term and longitudinal out- 
comes in the learner, the teacher, and the 
program. 
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° Assessment techniques must be selected to 
provide reliable and valid measurement 
of educational outcomes across a variety 
of teaching environments. 

• Academic health centers, educational pro- 
grams, and accrediting agencies should 
continue to develop monitoring and as- 
sessment approaches that meet the needs 
of different constituencies. 



VII. FINANCING THE EVOLUTION 
OF GRADUATE MEDICAL 
EDUCATION 

FINDING 7: The system of funding graduate 
medical education through teaching hospi- 
tals has inherent limitations and disincen- 
tives that inhibit the development of ambu- 
latory experiences and community-based 
educational programs. There is still no con- 
sensus on how to appropriately fund and 
expand the curriculum to reach into commu- 
nity settings. 

The financing of graduate medical education 
is complex and poorly understood. Studies have 
reported little consensus on the costs and other fi- 
nancial aspects of graduate medical education 
(Burg, Kelley, Zervanos, 1994). New models of 
graduate medical education, especially the substan- 
tial shifting of the locus of teaching to the commu- 
nity, further complicate this situation. Many authors 
have reported on the cost of education in the ambu- 
latory setting, particularly for medial students. As 
discussed earlier in this report, studies emphasize 
the time commitment of medical school and com- 
munity faculty, and loss or gain in clinical produc- 
tivity at the training site (Jones, Korn, 1997/ 
Goodwin, Gleason, Kontos, 1997/Rein, Randolph, 
Short et al, 1997/Franzini, Low, Proll, 1997) but 
assumptions drawn from the undergraduate expe- 
rience may not be valid for residents. In particular, 
residents generate clinical income and may be val- 
ued by the community site as potential physician 
recruits (Adams, Eisenberg, 1997/Jones, Culpepper, 
Shea, 1 995). An expert panel has recently proposed 
a general cost model for education in ambulatory 
settings as a basis for informed national debate 
(Boex, Blacklow, Boll et al, 1998). 

While the funding of the educational mission 
is highly specific to each school or residency pro- 
gram, certain generalizations can be made. State- 
supported medical schools receive a variable pro- 
portion of their revenues from their respective 
legislatures, usually in the form of faculty salary 



support for the educational enterprise. Private medi- 
cal schools are relatively more dependent on re- 
search grants and contracts, tuition, gifts, and en- 
dowments for the support of their medical student 
programs. Both public and private schools gener- 
ate about one third of total revenues from practice 
plans (Jones, Ganem, Williams, Krakower, 1998). 

GME is currently supported in substantial pro- 
portion by Medicare. Medicare funding is paid in 
the form of a direct capitation to teaching hospitals 
for each resident (Direct Medical Education sup- 
port or DME), and through a percentage added to 
patient care payments to teaching hospitals (Indi- 
rect Medical Education support or IME). The im- 
plications of recent and proposed changes in the 
funding of GME on the numbers and types of resi- 
dents and their educational process is unclear. 

It is currently difficult to foresee any substan- 
tial new funding for medical education from tradi- 
tional sources. The role of Federal government in 
GME is currently being reviewed. Medical school 
and residency program faculty are overextended in 
their current roles as they struggle to maintain teach- 
ing, research and clinical activities. Tuition ac- 
counts for only 3% of revenues for public schools 
and 5% for private institutions (Jones, Ganem, 
Williams, Yrakower, 1998), yet progressive in- 
creases in tuition fees at State-supported and private 
medical schools are becoming increasingly burden- 
some for students (Chhabra, 1996). Over 80% of 
the 1997 graduating class had educational debts — 
the highest percentage in eight years. The rate of 
increase of debt of medical students is increasing 
at alarming rates, particularly the growing propor- 
tion of graduating students carrying more than 
$100,000 in educational debts (Garrard, 1998). The 
mean debt for 1997 graduates of public medical 
schools was $69,000 compared to over $97,000 for 
graduates of private schools (Beran, Lawson, 1998). 

COGME believes that neither faculty nor learn- 
ers can be imposed upon for further increases in 
their financial contribution to medical education. 
As new systems of funding graduate medical edu- 
cation are developed, they must be based on effec- 
tive partnerships involving the health insurance in- 
dustry, organizations representing medical 
education, and State and Federal government agen- 
cies (Pew Commission Federal Policy Task Force, 
1998/Fogelman, Goode, Behrens et al, 1996, 
AAMC and COGME consortia reports). 

A major difficulty in designing new financial 
models for medical education is the lack of reli- 
able, specific financial data on the current system. 
Without baseline data concerning costs and value, 
it is difficult to estimate the financial implications 
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of proposed changes in medical education or to 
draw conclusions about their value to institutions 
and, more important, to the public. 

The nature of medical education makes the de- 
velopment of discrete educational budgets ex- 
tremely difficult. Learning by immersion in clini- 
cal activities and quasi-apprenticeship with role 
models are core values, but they are also carried 
out together with other activities, as “joint prod- 
ucts” which are the ones actually being supported 
financially. Many faculty members contribute to the 
teaching of residents and medical students with no 
direct remuneration from a teaching budget. Re- 
search faculty, who are often funded entirely from 
their research budgets, may also participate in teach- 
ing. Clinician faculty frequently teach both medi- 
cal students and residents in the course of provid- 
ing care to their own patients. Students and residents 
learn in environments where multiple other activi- 
ties may be taking place simultaneously using a 
single set of personnel and resources. For example 
clinical, educational, and research projects could 
all be active in a clinic where patients were being 
monitored for the results of their treatment. The 
synergy between the three activities of teaching, 
research and patient care has been central to teach- 
ing institutions for almost a century. The current 
emphasis on cost-consciousness exposes the cross- 
subsidies and threatens the ability to succeed in any 
single mission. The costs of each activity must be 
disentangled (Pew Commission Federal Policy 
Taskforce, 1998). 

The value, as distinct from the cost, of GME to 
the sponsoring academic medical center or other 
teaching hospital should also be assessed. The pres- 
tige of an affiliation with a teaching program may 
provide a marketing advantage with patients and 
healthcare plans. Other indirect benefits such as the 
ability to attract a higher quality medical staff and 
the creation of a more stimulating intellectual en- 
vironment may also accrue. While it will not be an 
easy task, the development and testing of more so- 
phisticated fiscal models may assist in arriving at 
progressively more accurate estimates of the cost 
of medical education. 

Medicare teaching funds have always been pro- 
vided on the basis that medical residents provide 
clinical service for which the sponsoring institu- 
tion should be reimbursed. Therefore, funds labeled 
as education have in fact been paid for an insepa- 
rable nexus of service and education. Because of 
the long-standing ambiguity on this point, this long- 
established principle is currently under serious re- 
view by the Medicare Payment Advisory Commis- 
sion, and the National Bipartisan Commission on 
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the Future of Medicare. The Pew Commission 
(1998) has recently drawn attention to another “pub- 
lic good”, that of uncompensated clinical care ren- 
dered by residents and faculty. 

In the private sector, similar arguments are tak- 
ing place. Many managed care organizations per- 
ceive no obligation to pay for medical education, 
particularly in the current highly competitive envi- 
ronment. These organizations will have still less 
incentive to contribute to medical education if a 
projected excess of physicians becomes reality and 
graduating physicians are perceived as poorly-pre- 
pared for managed care practice (Gold, 1996). Edu- 
cation is perceived as peripheral to the 
organization’s mission and, in the corporate view, 
may be more appropriately supported through other 
sources. 

In spite of the difficulties and complexities, dis- 
crete budgets for each activity are essential to moni- 
tor and manage the undertakings of teaching, pa- 
tient care and research. Without good financial data 
it is impossible to advocate for resources appropri- 
ate to any one of the trilogy or make meaningful 
proposals to enhance the synergy between them. 
More meaningful systems of financial management 
are crucial to achieve the levels of accountability 
and logical evolution of medical education advo- 
cated in this report. 

Alternative or supplementary mechanisms of 
funding resident education have been proposed. 
Among these are strategies to uncouple the fund- 
ing of residency programs from teaching hospital 
budgets and channel it more directly to the training 
program. Under these circumstances, the education 
program, with less dependence on the hospital for 
support, would have more flexibility to develop a 
program that more closely serves the educational 
needs of the residents., Perhaps more importantly, 
mechanisms might be developed to link funding to 
the learning and demonstration of specific compe- 
tencies. Thus, program funding would be linked not 
to hospital service but to the attainment of compe- 
tencies in its graduates that prepare them for medi- 
cal practice. (COGME Resource Paper, 1997/ 
COGME Sixth Report, 1995/ Pew, 1998). 

Preparation for the evolving medical practice 
environment requires that residents have experi- 
ences in non-traditional sites, which could include 
community health centers, health departments, phy- 
sician offices, free-standing surgical centers, and 
integrated health systems. Educators should be free 
to place resident learners wherever the highest 
standards of medical care are practiced in their com- 
munities and the best learning environments exist 
or can be developed. 



THIRTEENTH REPORT OF COGME 



26 



Establishing and sustaining quality teaching 
programs in community sites as advocated in this 
report requires resources. In the absence of new 
funding, medical schools and residency training 
programs will be faced with the necessity of redis- 
tributing their current budgets (Kassirer, 1996), and 
dispersing funds to clinician teachers in the com- 
munity. While this may create tension for adminis- 
trators and faculty alike, community clinicians and 
the organizations for which they work are becom- 
ing increasingly resistant to assuming a greater role 
in teaching without funding (Fogelman et al, 1996). 
Unquestionably paying clinical teachers in the com- 
munity does create additional cost for teaching in- 
stitutions, but it also imposes greater accountabil- 
ity on community faculty. 

Regardless of the extent to which the principle 
of subsidizing medical education through clinical 
revenues will continue to be recognized, compe- 
tency-based educational goals will not be achiev- 
able without significant levels of accountability 
throughout the system. COGME believes that teach- 
ing institutions should re-examine the financing of 
their education programs. They should attend to the 
urgent needs and recommendations set forth here 
without waiting for new sources of support to be 
found. 

The GME system that finally emerges should 
recognize the vital national interest of educating 
the country’s future physicians appropriately while 
distributing the costs to those, including patients 
and the health care industry, who benefit most. The 
system and its financing must be constructed to 
provide value. The asset to society, health care or- 
ganizations, and individuals of well-prepared phy- 
sicians must represent excellent value for the re- 
sources invested through taxes, payments and other 
forms of financing. 

Recommendations: 

* A stable, reliable source of funding for 
graduate medical education is essential. 
While it is appropriate to assume that the 
Federal government through the Medi- 
care program will continue to support 
graduate medical education, COGME en- 
dorses efforts to ensure that all payers in- 
cluding the Federal government support 
an equitable share of medical education 
costs. 

• Medical schools, teaching hospitals and 
major stakeholders should prepare to fi- 
nance physician education programs that 
incorporate the changes recommended in 
this report. Most of the funds to support 



these changes will require shifting exist- 
ing internal resources within the academic 
enterprise. 

• Funding for residency programs must 
provide the flexibility to meet the educa- 
tional needs of residents. Program fund- 
ing should be structured to enable gradu- 
ates to attain the knowledge, skills, 
attitudes and values that will meet both 
the profession’s goals and community 
needs. 

• The value of graduate medical education 
to the sponsoring institution should be de- 
termined through a candid and explicit 
assessment of its financial, educational 
and service contribution to the achieve- 
ment of the institution’s mission. 



■VBII. SUSTAINING QUALITY AN ID 
VITALITY IN MEDICAL EDUCATION 

Finding 8: Creating and sustaining the edu- 
cational changes required to respond to the 
changing medical environment will continue 
to be a challenge given the pressures of the 
medical marketplace and the complex mis- 
sions of medical schools , academic medical 
centers and other teaching hospitals . 

U.S. medical schools have experienced several 
changes in their culture during the last century. 
Since the Flexner report in 1910, a scientifically- 
based curriculum has been the core of medical edu- 
cation. This emphasis has contributed immeasur- 
ably to the establishment of modem medicine as a 
science-based profession. While there have been a 
number of significant evolutionary changes, revi- 
sions of the magnitude created by the Flexner re- 
port have not occurred. This report calls for com- 
prehensive and profound change in full recognition 
that this challenge is made at a time of unprec- 
edented difficulty for medical schools and residency 
programs. For many reasons, modification of ex- 
isting educational programs and the introduction 
of new ones is becoming progressively more diffi- 
cult, Resources are. diminishing and there are 
mounting pressures on medical school and resi- 
dency faculty to generate clinical income to sup- 
port educational programs and research activities. 
The missions of research, clinical service and teach- 
ing are often in conflict, creating a tension between 
medical school and residency administrators and 
their faculty. Teaching institutions increasingly rely 
on clinical and contractual income to support mul- 
tiple activities with consequent reduction of faculty 
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time available for teaching and the development of 
educational programs. 

In spite of these pressures, medical schools and 
residency programs are institutions of enormous 
vitality, commanding impressive intellectual and 
other resources. Some schools and programs have 
been remarkably successful in introducing curricu- 
lum change. Their strategies may serve as models 
to other programs. A comprehensive approach to 
the introduction of new curriculum topics is hard 
to achieve and maintain particularly as in many 
“new” curricular areas such as human sexuality, 
alcoholism, and health care economics, the content 
does not fit well with traditional departmental re- 
sponsibilities and courses may serve learners from 
several disciplines or health professions. As stated 
previously, some institutions may address the chal- 
lenge to prepare physicians for the future by an in- 
cremental approach of continual modification to the 
existing curriculum. For others, perhaps the major- 
ity, major curricular reform will be the only fea- 
sible method of adequately preparing graduates for 
the realities of practice. Whatever approach is se- 
lected, the development of a substantial system of 
community sites to complement the role of the AHC 
and teaching hospital will be essential to provide 
the range of experiences required in modem medi- 
cal education. 

Many institutions have recognized the magni- 
tude of the necessary change. In order to identify, 
implement, and sustain revisions in their educa- 
tional programs medical schools and residency pro- 
grams are reexamining their missions and culture, 
and committing the necessary funding and other 
resources to re-affirm their educational mission and 
tradition. Cultural change in any organization is 
difficult to accomplish and does not occur rapidly. 
Perpetuating comfortable and familiar strategies 
will simply widen the gap between the content of 
current educational programs, and the realities of 
medical practice for which graduates must be prepared. 

This report emphasizes the development of 
teaching sites in the community that reflect the best 
of medical practice. The clinical teachers at com- 
munity sites will be responsible for carrying out a 
significant portion of the clinical teaching mission 
of medical schools and residency training programs. 
As they come to understand that mission and par- 
ticipate in the growth and development of educa- 
tional programs they will add an enriching perspec- 
tive. Their contribution to the institution’s programs 
and policies promises to be an influence that will 
maintain program relevance and strengthen links to 
the community. In spite of the many implications of 
closer relationships between “traditional” and com- 
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munity faculty, this strategy has enormous potential 
benefit to medical schools and residency programs. 

As discussed previously, the development of an 
expanded teaching faculty in the community is 
likely to redefine the role of some “traditional” fac- 
ulty members, requiring greater emphasis on plan- 
ning, management, and evaluative functions. The 
clearer definition of the educational administrative 
role and its legitimization by the development of 
appropriate academic promotion systems is likely 
expand the cadre of faculty focused on medical 
education. The consequent expansion of research 
and development in medical education has the po- 
tential for enormous vitality and benefit to medical 
schools and residency programs. 

The availability of funding from private foun- 
dations and Federal and State funding agencies has 
often been necessary to initiate curriculum change. 
The role of accrediting organizations at the State 
and national level has also been significant. Clearly, 
patients and health care organizations will continue 
to exert an influence on the quality standards of 
new graduates. Feedback from graduates may be 
the most effective stimulus to change as these indi- 
viduals can articulate their experiences of discrep- 
ancies between their professional preparation and 
the expectations and realities of practice. 

In the final analysis, the responsibility of medi- 
cal schools to educate medical students is a unique 
and valued function. Other institutions conduct re- 
search and deliver medical care. Further, medical 
school is the foundation for graduate education, 
fellowship training and eventual practice. The 
changes recommended here must, therefore, begin 
in our medical schools. The vitality to implement 
and sustain a system of medical education which 
continually evolves to meet the changing needs of 
patients will come from the faculty, learners, gradu- 
ates, community partners, and society at large. The 
implicit dedication of faculty members will be en- 
hanced by greater clarity of professional roles, im- 
proved concordance between rewards (both finan- 
cial and academic) and actual responsibilities, 
systems of continuous career development, greater 
sense of accomplishment in appropriately prepar- 
ing physicians, and the potential of expanded areas 
for scholarship in educationally-based topics. Vi- 
tality in learners will be enhanced by appreciation 
of the appropriateness of their training and the ex- 
panded use of adult learning techniques. Finally, in- 
teraction with vigorous community partners in the new 
educational systems and the acknowledgment by so- 
ciety that its physicians are superbly prepared for prac- 
tice, will enable medical educators to sustain excel- 
lence throughout times of continual change. 
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Recommendations: 

° Medical schools, residency training pro- 
grams and teaching hospitals must bal- 
ance their competing roles and reaffirm 
their educational mission. They should 
embrace the task of meeting societal need 
through the education of their graduates. 



• The standards for accreditation and finan- 
cial support of residency programs should 
be revised to encourage and facilitate new 
curriculum content and opportunities to 
acquire additional knowledge, skills, atti- 
tudes and values. 
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Selected Internet Resources 



The volatility of the Internet precludes the development of “comprehensive” listings of resources sites. 
Faculties are urged to use the resources of the net to exploit its capabilities. Examples of the types of 
resources available at the time of this publication include the following (Note that no endorsement is 
implied and as with all net resources caveat emptor): 



Medical Education Ring 

h ttp://www. med.jhu. edu/medcenter/mer 
Educational resources per se and links to sites 
that contain information relative to medical edu- 
cation. 

The Interactive Patient 

http.V/medicus. marshall.edu/medicus.htm 
A web-based interactive patient encounter simu- 
lation. 

Medical Information for Students and 

PROFESSIONALS 

http://www. teleport, com/ -megan/health. shtml 
Links to information regarding basic and clini- 
cal science courses. 

Meducation 

http://www.meducation.com 
A comprehensive world wide listing of medical 
education links. 

Web Doctor 

h ttp://www.gretman.com/webdocotr/home. htm 
A comprehensive index of Internet medical re- 
sources. A virtual library of peer-reviewed, pro- 
fessional medical information. 



U.S. Distance Learning Association 
http://usdla.org 

A membership organization of professionals in- 
terested in distance learning. 

Center for Excellence in Distance 
Learning 

http://www. lucent, com/ cedi 

Listings of technologies, alliances and resources. 

The Education Coalition 

http://www. tecweb.org 

In existence since 1933 promoting systematic 
educational reform through the use of multiple 
technologies. 

Partnerships for Quality Education 

h ttp ://www. pqe. org 

Listing of participating residency programs and 
their managed care partners 

Undergraduate Medical Education for 
the 21 st Century (UME-21) 

http://www.aacom.org/UME-21/schools.htm 
A demonstration of curriculum innovations to 
keep pace with the changing health care envi- 
ronment 
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